2021-02-06T22:40:33.104 INFO:root:teuthology version: 1.1.0-17c09965 2021-02-06T22:40:33.106 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi --archive /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482 --description rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/orig.config.yaml 2021-02-06T22:40:34.325 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-06T22:40:34.384 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482 branch: wip-yuri7-testing-2021-02-02-0942-pacific description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '5862482' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: '8.2' overrides: admin_socket: branch: wip-yuri7-testing-2021-02-02-0942-pacific ceph: conf: global: debug ms: 1 debug objecter: 20 debug rados: 20 mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 5 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_FULL\) - \(SLOW_OPS\) - \(MON_DOWN\) - \(PG_ - \(POOL_APP_NOT_ENABLED\) - \(SMALLER_PGP_NUM\) - slow request log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2021-02-02-0942-pacific sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri7-testing-2021-02-02-0942-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc targets: smithi051.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjrPeE+qpRsebVTSNeTgeYTJxASEQ3UAZtzufwYKkhrqnSEQmbL4oUieaEIsqou3HWw0bIK0FszBAJsIGcfRhT8i8PKBCzH73E77F+9coJX/kjuuqmh7wYDMhGI3v3gl0kL/8zwr5Z9Q6JiBdHgHdPFmmcKUQZCt1xF0ssYMCNp12VDioB5x4FpVCcfHL61SxuHnLffxH3MywAcWAXCMxWH+PdiH5HPHwCXUxC5JkoTLdq1zyXvEq+K/KnOkpAH2k3h7GDwUfSjifRZ7ZjBJGUON693loYPBsl6rhUF9XSF8CI6bl2oQ963Z1jfGvg+wtNFtTMLNjE+Pl4/26ZpXFPZ4S1qipDe7E1oAIokmBzbSEVFuZBVmBIdf0XX6NqnW9Ms1BTwn9rdSEWa0jjYKNUmDoPhtiftfGCb7xQEMd/lozHi2oWIDSlPhDb9NMNdekV8qFy+hWDKHCSTHQwhO+E5LFoWgtCir1Uw/I4xmNAjiLF0T5TQcsqTw1V6bCdFJ0= smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnQTjyZoqdhr0NhIt5gsZMttHBL2P8pNn2mwcUMnfGUna9bxNk0lrsNj4rSxN/DrNngVeIlF4LwBPGnxxxiRD4rue6QN45eiq5SYnD5NuF6zY0DkkNbW2n67ukIy+u7IrpOqx+WQB4jy9GdyrebU31z8GvN6TESNuuu4MAkRMe0EjPg8rYwFEVGiZbo2U7tAgrf5oxls3LOnBJVXIPL/xUp6bpXTWXS6NYj2E2qJhLSo8Bt6G3W4qR490SPSb2LJFQ6jLC0TpgqPRWSoRDHQ5xKSoiqrff4t9a6Bv3H5GAkZCiiyD2tz9Yup/DWJz3KYUL1eW4PuMvkhLgotvOczBZitjTdNJHShtejXbdaDw+YhmWOkS0XwsISZC7tigKR1o8ZPgGi5sOWDYZN8rveWKhi0/nnFmMeK7WVbGefaIV4XdDsj80XtkF30RatbiVMszHJLqnXAhge59fCzuKFKbWO8rtg3ZrblZAPVbqwGrI5CAE9MwYnrU8jrtF/V1M5s= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - rados/test.sh teuthology_branch: master teuthology_sha1: 17c099650191e7aa47a7d9f502facca74f9b4d44 timestamp: 2021-02-06_18:09:20 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.14226 2021-02-06T22:40:34.385 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa; will attempt to use it 2021-02-06T22:40:34.385 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks 2021-02-06T22:40:34.386 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-06T22:40:34.388 INFO:teuthology.task.internal:Checking packages... 2021-02-06T22:40:34.410 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc' 2021-02-06T22:40:34.410 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-06T22:40:34.411 INFO:teuthology.packaging:ref: None 2021-02-06T22:40:34.411 INFO:teuthology.packaging:tag: None 2021-02-06T22:40:34.411 INFO:teuthology.packaging:branch: wip-yuri7-testing-2021-02-02-0942-pacific 2021-02-06T22:40:34.411 INFO:teuthology.packaging:sha1: 39ebd5ec4ebd7319faeb68d09b00b18fb45299cc 2021-02-06T22:40:34.412 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri7-testing-2021-02-02-0942-pacific 2021-02-06T22:40:34.581 INFO:teuthology.task.internal:Found packages for ceph version 16.1.0-114.g39ebd5ec 2021-02-06T22:40:34.581 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-06T22:40:34.592 INFO:teuthology.task.internal:no buildpackages task found 2021-02-06T22:40:34.592 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-06T22:40:34.605 INFO:teuthology.task.internal:Saving configuration 2021-02-06T22:40:34.620 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-06T22:40:34.631 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-06T22:40:34.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-06 22:35:52.141860', 'description': '/home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPkcJjdBOH3+x+K2k20V/3dHOr6fNJQAIgS3pBZt0Cmdkf6fqXbOcVsIqret+0dBCGG2S9+tAbLI9a201IfN28U=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi051.front.sepia.ceph.com'} 2021-02-06T22:40:34.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-06 22:35:52.141880', 'description': '/home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNNobUUj94GW6GjDmScKR74NeLbaK2Ub7nE+morvqSg1Vplqm16xf2D8eQHZCLFd7INpIhC/Zj2LNo4/dzIVEvA=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi106.front.sepia.ceph.com'} 2021-02-06T22:40:34.668 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-06T22:40:34.678 INFO:teuthology.task.internal:roles: ubuntu@smithi051.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2021-02-06T22:40:34.678 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2021-02-06T22:40:34.679 INFO:teuthology.run_tasks:Running task console_log... 2021-02-06T22:40:34.744 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1b2bab91e0>, signals=[15]) 2021-02-06T22:40:34.745 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-06T22:40:34.756 INFO:teuthology.task.internal:Opening connections... 2021-02-06T22:40:34.756 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:40:34.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:40:34.834 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:40:34.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:40:34.908 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-06T22:40:34.918 DEBUG:teuthology.orchestra.run.smithi051:> uname -m 2021-02-06T22:40:34.951 INFO:teuthology.orchestra.run.smithi051.stdout:x86_64 2021-02-06T22:40:34.952 DEBUG:teuthology.orchestra.run.smithi051:> cat /etc/os-release 2021-02-06T22:40:35.006 INFO:teuthology.orchestra.run.smithi051.stdout:NAME="CentOS Linux" 2021-02-06T22:40:35.006 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION="8 (Core)" 2021-02-06T22:40:35.007 INFO:teuthology.orchestra.run.smithi051.stdout:ID="centos" 2021-02-06T22:40:35.007 INFO:teuthology.orchestra.run.smithi051.stdout:ID_LIKE="rhel fedora" 2021-02-06T22:40:35.007 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION_ID="8" 2021-02-06T22:40:35.007 INFO:teuthology.orchestra.run.smithi051.stdout:PLATFORM_ID="platform:el8" 2021-02-06T22:40:35.007 INFO:teuthology.orchestra.run.smithi051.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-06T22:40:35.008 INFO:teuthology.orchestra.run.smithi051.stdout:ANSI_COLOR="0;31" 2021-02-06T22:40:35.008 INFO:teuthology.orchestra.run.smithi051.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-06T22:40:35.008 INFO:teuthology.orchestra.run.smithi051.stdout:HOME_URL="https://www.centos.org/" 2021-02-06T22:40:35.008 INFO:teuthology.orchestra.run.smithi051.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-06T22:40:35.008 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:40:35.009 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-06T22:40:35.009 INFO:teuthology.orchestra.run.smithi051.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-06T22:40:35.009 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-06T22:40:35.009 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-06T22:40:35.009 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:40:35.010 INFO:teuthology.lock.ops:Updating smithi051.front.sepia.ceph.com on lock server 2021-02-06T22:40:35.027 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2021-02-06T22:40:35.045 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2021-02-06T22:40:35.045 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2021-02-06T22:40:35.098 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Linux" 2021-02-06T22:40:35.099 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8 (Core)" 2021-02-06T22:40:35.099 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos" 2021-02-06T22:40:35.099 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora" 2021-02-06T22:40:35.100 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8" 2021-02-06T22:40:35.100 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2021-02-06T22:40:35.100 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2021-02-06T22:40:35.100 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2021-02-06T22:40:35.100 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-02-06T22:40:35.101 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.centos.org/" 2021-02-06T22:40:35.101 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-02-06T22:40:35.101 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:40:35.101 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-02-06T22:40:35.101 INFO:teuthology.orchestra.run.smithi106.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-02-06T22:40:35.102 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2021-02-06T22:40:35.102 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2021-02-06T22:40:35.102 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:40:35.102 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2021-02-06T22:40:35.119 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-06T22:40:35.132 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-06T22:40:35.180 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-06T22:40:35.180 DEBUG:teuthology.orchestra.run.smithi051:> test '!' -e /home/ubuntu/cephtest 2021-02-06T22:40:35.183 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2021-02-06T22:40:35.196 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-06T22:40:35.218 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-06T22:40:35.219 DEBUG:teuthology.orchestra.run.smithi051:> test -z $(ls -A /var/lib/ceph) 2021-02-06T22:40:35.237 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2021-02-06T22:40:35.258 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-06T22:40:35.303 INFO:teuthology.run_tasks:Running task kernel... 2021-02-06T22:40:35.320 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-02-06T22:40:35.320 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-06T22:40:35.321 DEBUG:teuthology.orchestra.run.smithi051:> uname -r 2021-02-06T22:40:35.336 INFO:teuthology.orchestra.run.smithi051.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-06T22:40:35.337 INFO:teuthology.task.kernel:Running kernel on smithi051: 4.18.0-193.28.1.el8_2.x86_64 2021-02-06T22:40:35.337 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum install -y kernel 2021-02-06T22:40:38.553 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - AppStream 26 MB/s | 6.3 MB 00:00 2021-02-06T22:40:39.704 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Base 23 MB/s | 2.3 MB 00:00 2021-02-06T22:40:40.225 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Extras 127 kB/s | 8.6 kB 00:00 2021-02-06T22:40:40.671 INFO:teuthology.orchestra.run.smithi051.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.8 MB 00:00 2021-02-06T22:40:42.611 INFO:teuthology.orchestra.run.smithi051.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2021-02-06T22:40:43.852 INFO:teuthology.orchestra.run.smithi051.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-06T22:40:43.853 INFO:teuthology.orchestra.run.smithi051.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-06T22:40:44.029 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:40:44.039 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:40:44.039 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:40:44.040 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:40:44.040 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:40:44.040 INFO:teuthology.orchestra.run.smithi051.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-06T22:40:44.040 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrading: 2021-02-06T22:40:44.041 INFO:teuthology.orchestra.run.smithi051.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-06T22:40:44.041 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:40:44.041 INFO:teuthology.orchestra.run.smithi051.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-06T22:40:44.041 INFO:teuthology.orchestra.run.smithi051.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-06T22:40:44.041 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:40:44.042 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:40:44.042 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:40:44.042 INFO:teuthology.orchestra.run.smithi051.stdout:Install 3 Packages 2021-02-06T22:40:44.042 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrade 1 Package 2021-02-06T22:40:44.043 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:40:44.043 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 162 M 2021-02-06T22:40:44.043 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:40:44.304 INFO:teuthology.orchestra.run.smithi051.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 17 MB/s | 4.3 MB 00:00 2021-02-06T22:40:45.842 INFO:teuthology.orchestra.run.smithi051.stdout:(2/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 14 MB/s | 26 MB 00:01 2021-02-06T22:40:46.210 INFO:teuthology.orchestra.run.smithi051.stdout:(3/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 14 MB/s | 30 MB 00:02 2021-02-06T22:40:47.509 INFO:teuthology.orchestra.run.smithi051.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 32 MB/s | 101 MB 00:03 2021-02-06T22:40:47.513 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:40:47.513 INFO:teuthology.orchestra.run.smithi051.stdout:Total 47 MB/s | 162 MB 00:03 2021-02-06T22:40:47.611 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:40:47.934 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:40:47.935 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:40:49.656 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:40:49.657 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:41:00.228 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:41:02.139 INFO:teuthology.orchestra.run.smithi051.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-06T22:41:02.691 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:41:05.545 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:41:05.891 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:41:08.982 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:41:09.187 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-06T22:41:09.428 INFO:teuthology.orchestra.run.smithi051.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:41:30.441 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-06T22:41:30.777 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:41:30.777 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-06T22:41:30.778 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:41:30.778 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:41:30.778 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-06T22:41:31.709 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:41:31.710 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:41:31.710 INFO:teuthology.orchestra.run.smithi051.stdout:Upgraded: 2021-02-06T22:41:31.710 INFO:teuthology.orchestra.run.smithi051.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-06T22:41:31.711 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:41:31.711 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:41:31.711 INFO:teuthology.orchestra.run.smithi051.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:41:31.711 INFO:teuthology.orchestra.run.smithi051.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:41:31.712 INFO:teuthology.orchestra.run.smithi051.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:41:31.712 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:41:31.712 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:41:31.866 DEBUG:teuthology.orchestra.run.smithi051:> rpm -q kernel --last | head -n 1 2021-02-06T22:41:31.984 INFO:teuthology.orchestra.run.smithi051.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Sat 06 Feb 2021 10:41:08 PM UTC 2021-02-06T22:41:31.985 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:41:31.985 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:41:31.986 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2021-02-06T22:41:32.003 INFO:teuthology.orchestra.run.smithi106.stdout:4.18.0-193.28.1.el8_2.x86_64 2021-02-06T22:41:32.004 INFO:teuthology.task.kernel:Running kernel on smithi106: 4.18.0-193.28.1.el8_2.x86_64 2021-02-06T22:41:32.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum install -y kernel 2021-02-06T22:41:34.704 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - AppStream 38 MB/s | 6.3 MB 00:00 2021-02-06T22:41:35.770 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - Base 26 MB/s | 2.3 MB 00:00 2021-02-06T22:41:36.206 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - Extras 132 kB/s | 8.6 kB 00:00 2021-02-06T22:41:36.588 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 27 MB/s | 8.8 MB 00:00 2021-02-06T22:41:38.405 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 4.1 MB/s | 24 kB 00:00 2021-02-06T22:41:39.473 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-4.18.0-193.el8.x86_64 is already installed. 2021-02-06T22:41:39.473 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-4.18.0-193.28.1.el8_2.x86_64 is already installed. 2021-02-06T22:41:39.677 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:41:39.688 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:41:39.689 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:41:39.689 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:41:39.689 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:41:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: kernel x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 4.3 M 2021-02-06T22:41:39.690 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2021-02-06T22:41:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware noarch 20200619-101.git3890db36.el8_3 CentOS-Base 101 M 2021-02-06T22:41:39.690 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:41:39.690 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 30 M 2021-02-06T22:41:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules x86_64 4.18.0-240.10.1.el8_3 CentOS-Base 26 M 2021-02-06T22:41:39.691 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:41:39.691 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:41:39.691 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:41:39.691 INFO:teuthology.orchestra.run.smithi106.stdout:Install 3 Packages 2021-02-06T22:41:39.692 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 1 Package 2021-02-06T22:41:39.692 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:41:39.692 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 162 M 2021-02-06T22:41:39.693 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:41:39.800 INFO:teuthology.orchestra.run.smithi106.stdout:(1/4): kernel-4.18.0-240.10.1.el8_3.x86_64.rpm 40 MB/s | 4.3 MB 00:00 2021-02-06T22:41:40.963 INFO:teuthology.orchestra.run.smithi106.stdout:(2/4): kernel-modules-4.18.0-240.10.1.el8_3.x86 20 MB/s | 26 MB 00:01 2021-02-06T22:41:41.210 INFO:teuthology.orchestra.run.smithi106.stdout:(3/4): kernel-core-4.18.0-240.10.1.el8_3.x86_64 20 MB/s | 30 MB 00:01 2021-02-06T22:41:42.210 INFO:teuthology.orchestra.run.smithi106.stdout:(4/4): linux-firmware-20200619-101.git3890db36. 42 MB/s | 101 MB 00:02 2021-02-06T22:41:42.212 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:41:42.213 INFO:teuthology.orchestra.run.smithi106.stdout:Total 64 MB/s | 162 MB 00:02 2021-02-06T22:41:42.303 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:41:42.587 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:41:42.587 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:41:44.237 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:41:44.238 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:41:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:41:56.012 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : linux-firmware-20200619-101.git3890db36.el8_3.noarch 1/5 2021-02-06T22:41:56.537 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:41:59.221 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:41:59.545 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:42:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:42:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : kernel-4.18.0-240.10.1.el8_3.x86_64 4/5 2021-02-06T22:42:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:42:22.456 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: kernel-core-4.18.0-240.10.1.el8_3.x86_64 5/5 2021-02-06T22:42:22.797 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:42:22.798 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-4.18.0-240.10.1.el8_3.x86_64 1/5 2021-02-06T22:42:22.798 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-core-4.18.0-240.10.1.el8_3.x86_64 2/5 2021-02-06T22:42:22.798 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : kernel-modules-4.18.0-240.10.1.el8_3.x86_64 3/5 2021-02-06T22:42:22.799 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20200619-101.git3890db36.el8_3.noarch 4/5 2021-02-06T22:42:23.185 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : linux-firmware-20191202-97.gite8a0f4c9.el8.noarch 5/5 2021-02-06T22:42:23.185 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:42:23.185 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2021-02-06T22:42:23.186 INFO:teuthology.orchestra.run.smithi106.stdout: linux-firmware-20200619-101.git3890db36.el8_3.noarch 2021-02-06T22:42:23.186 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:42:23.186 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:42:23.187 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.187 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-core-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.187 INFO:teuthology.orchestra.run.smithi106.stdout: kernel-modules-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.187 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:42:23.188 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:42:23.318 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel --last | head -n 1 2021-02-06T22:42:23.431 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Sat 06 Feb 2021 10:42:02 PM UTC 2021-02-06T22:42:23.432 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.433 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-193.28.1.el8_2.x86_64 Expected: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.434 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-06T22:42:23.434 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-06T22:42:23.435 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-06T22:42:23.435 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-02-06T22:42:23.436 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi051.front.sepia.ceph.com, path=None, version=distro) 2021-02-06T22:42:23.436 DEBUG:teuthology.orchestra.run.smithi051:> rpm -q kernel --last | head -n 1 2021-02-06T22:42:23.539 INFO:teuthology.orchestra.run.smithi051.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Sat 06 Feb 2021 10:41:08 PM UTC 2021-02-06T22:42:23.541 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.541 DEBUG:teuthology.orchestra.run.smithi051:> sudo rpm -qi grub2-tools 2021-02-06T22:42:23.574 INFO:teuthology.orchestra.run.smithi051.stdout:Name : grub2-tools 2021-02-06T22:42:23.574 INFO:teuthology.orchestra.run.smithi051.stdout:Epoch : 1 2021-02-06T22:42:23.575 INFO:teuthology.orchestra.run.smithi051.stdout:Version : 2.02 2021-02-06T22:42:23.575 INFO:teuthology.orchestra.run.smithi051.stdout:Release : 81.el8 2021-02-06T22:42:23.575 INFO:teuthology.orchestra.run.smithi051.stdout:Architecture: x86_64 2021-02-06T22:42:23.575 INFO:teuthology.orchestra.run.smithi051.stdout:Install Date: Fri 13 Nov 2020 03:02:55 PM UTC 2021-02-06T22:42:23.576 INFO:teuthology.orchestra.run.smithi051.stdout:Group : System Environment/Base 2021-02-06T22:42:23.576 INFO:teuthology.orchestra.run.smithi051.stdout:Size : 9192705 2021-02-06T22:42:23.576 INFO:teuthology.orchestra.run.smithi051.stdout:License : GPLv3+ 2021-02-06T22:42:23.576 INFO:teuthology.orchestra.run.smithi051.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-06T22:42:23.576 INFO:teuthology.orchestra.run.smithi051.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-06T22:42:23.577 INFO:teuthology.orchestra.run.smithi051.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-06T22:42:23.577 INFO:teuthology.orchestra.run.smithi051.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-06T22:42:23.577 INFO:teuthology.orchestra.run.smithi051.stdout:Relocations : (not relocatable) 2021-02-06T22:42:23.577 INFO:teuthology.orchestra.run.smithi051.stdout:Packager : CentOS BuildSystem 2021-02-06T22:42:23.578 INFO:teuthology.orchestra.run.smithi051.stdout:Vendor : CentOS 2021-02-06T22:42:23.578 INFO:teuthology.orchestra.run.smithi051.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-06T22:42:23.578 INFO:teuthology.orchestra.run.smithi051.stdout:Summary : Support tools for GRUB. 2021-02-06T22:42:23.578 INFO:teuthology.orchestra.run.smithi051.stdout:Description : 2021-02-06T22:42:23.579 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:42:23.579 INFO:teuthology.orchestra.run.smithi051.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-06T22:42:23.579 INFO:teuthology.orchestra.run.smithi051.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-06T22:42:23.579 INFO:teuthology.orchestra.run.smithi051.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-06T22:42:23.580 INFO:teuthology.orchestra.run.smithi051.stdout:hardware devices. 2021-02-06T22:42:23.581 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:42:23.581 INFO:teuthology.orchestra.run.smithi051.stdout:This subpackage provides tools for support of all platforms. 2021-02-06T22:42:23.583 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-06T22:42:23.583 INFO:teuthology.task.kernel:Updating grub on smithi051 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:23.584 DEBUG:teuthology.orchestra.run.smithi051:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-06T22:42:24.242 INFO:teuthology.orchestra.run.smithi051.stderr:Generating grub configuration file ... 2021-02-06T22:42:26.066 INFO:teuthology.orchestra.run.smithi051.stderr:done 2021-02-06T22:42:26.067 DEBUG:teuthology.orchestra.run.smithi051:> mktemp 2021-02-06T22:42:26.082 INFO:teuthology.orchestra.run.smithi051.stdout:/tmp/tmp.AFT6hPMepP 2021-02-06T22:42:26.082 DEBUG:teuthology.orchestra.run.smithi051:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AFT6hPMepP 2021-02-06T22:42:26.151 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 0666 /tmp/tmp.AFT6hPMepP 2021-02-06T22:42:26.307 DEBUG:teuthology.orchestra.remote:smithi051:/tmp/tmp.AFT6hPMepP is 4KB 2021-02-06T22:42:26.357 DEBUG:teuthology.orchestra.run.smithi051:> rm -fr /tmp/tmp.AFT6hPMepP 2021-02-06T22:42:26.371 DEBUG:teuthology.orchestra.run.smithi051:> sudo /bin/ls /boot/loader/entries || true 2021-02-06T22:42:26.434 INFO:teuthology.orchestra.run.smithi051.stdout:2951a06464bf41f6a3bf91594147ecff-0-rescue.conf 2021-02-06T22:42:26.434 INFO:teuthology.orchestra.run.smithi051.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-06T22:42:26.434 INFO:teuthology.orchestra.run.smithi051.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.el8.x86_64.conf 2021-02-06T22:42:26.434 INFO:teuthology.orchestra.run.smithi051.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-06T22:42:26.435 DEBUG:teuthology.orchestra.run.smithi051:> sudo grub2-set-default 2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:26.625 DEBUG:teuthology.orchestra.run.smithi051:> sudo shutdown -r now 2021-02-06T22:42:26.628 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-02-06T22:42:26.628 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2021-02-06T22:42:26.629 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel --last | head -n 1 2021-02-06T22:42:26.724 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-4.18.0-240.10.1.el8_3.x86_64 Sat 06 Feb 2021 10:42:02 PM UTC 2021-02-06T22:42:26.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:26.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo rpm -qi grub2-tools 2021-02-06T22:42:26.757 INFO:teuthology.orchestra.run.smithi106.stdout:Name : grub2-tools 2021-02-06T22:42:26.757 INFO:teuthology.orchestra.run.smithi106.stdout:Epoch : 1 2021-02-06T22:42:26.757 INFO:teuthology.orchestra.run.smithi106.stdout:Version : 2.02 2021-02-06T22:42:26.758 INFO:teuthology.orchestra.run.smithi106.stdout:Release : 81.el8 2021-02-06T22:42:26.758 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: x86_64 2021-02-06T22:42:26.758 INFO:teuthology.orchestra.run.smithi106.stdout:Install Date: Fri 13 Nov 2020 03:02:55 PM UTC 2021-02-06T22:42:26.758 INFO:teuthology.orchestra.run.smithi106.stdout:Group : System Environment/Base 2021-02-06T22:42:26.759 INFO:teuthology.orchestra.run.smithi106.stdout:Size : 9192705 2021-02-06T22:42:26.759 INFO:teuthology.orchestra.run.smithi106.stdout:License : GPLv3+ 2021-02-06T22:42:26.759 INFO:teuthology.orchestra.run.smithi106.stdout:Signature : RSA/SHA256, Tue 14 Apr 2020 03:18:37 PM UTC, Key ID 05b555b38483c65d 2021-02-06T22:42:26.759 INFO:teuthology.orchestra.run.smithi106.stdout:Source RPM : grub2-2.02-81.el8.src.rpm 2021-02-06T22:42:26.759 INFO:teuthology.orchestra.run.smithi106.stdout:Build Date : Tue 14 Apr 2020 02:54:04 PM UTC 2021-02-06T22:42:26.760 INFO:teuthology.orchestra.run.smithi106.stdout:Build Host : kbuilder.bsys.centos.org 2021-02-06T22:42:26.760 INFO:teuthology.orchestra.run.smithi106.stdout:Relocations : (not relocatable) 2021-02-06T22:42:26.760 INFO:teuthology.orchestra.run.smithi106.stdout:Packager : CentOS BuildSystem 2021-02-06T22:42:26.760 INFO:teuthology.orchestra.run.smithi106.stdout:Vendor : CentOS 2021-02-06T22:42:26.760 INFO:teuthology.orchestra.run.smithi106.stdout:URL : http://www.gnu.org/software/grub/ 2021-02-06T22:42:26.761 INFO:teuthology.orchestra.run.smithi106.stdout:Summary : Support tools for GRUB. 2021-02-06T22:42:26.761 INFO:teuthology.orchestra.run.smithi106.stdout:Description : 2021-02-06T22:42:26.761 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:42:26.761 INFO:teuthology.orchestra.run.smithi106.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-02-06T22:42:26.761 INFO:teuthology.orchestra.run.smithi106.stdout:customizable bootloader with modular architecture. It supports a rich 2021-02-06T22:42:26.762 INFO:teuthology.orchestra.run.smithi106.stdout:variety of kernel formats, file systems, computer architectures and 2021-02-06T22:42:26.762 INFO:teuthology.orchestra.run.smithi106.stdout:hardware devices. 2021-02-06T22:42:26.762 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:42:26.762 INFO:teuthology.orchestra.run.smithi106.stdout:This subpackage provides tools for support of all platforms. 2021-02-06T22:42:26.763 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-02-06T22:42:26.763 INFO:teuthology.task.kernel:Updating grub on smithi106 to boot 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:26.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-02-06T22:42:28.537 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2021-02-06T22:42:30.334 INFO:teuthology.orchestra.run.smithi106.stderr:done 2021-02-06T22:42:30.335 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2021-02-06T22:42:30.355 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.A6U7Eejzwd 2021-02-06T22:42:30.356 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A6U7Eejzwd 2021-02-06T22:42:30.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.A6U7Eejzwd 2021-02-06T22:42:30.574 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.A6U7Eejzwd is 4KB 2021-02-06T22:42:30.623 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.A6U7Eejzwd 2021-02-06T22:42:30.637 DEBUG:teuthology.orchestra.run.smithi106:> sudo /bin/ls /boot/loader/entries || true 2021-02-06T22:42:30.699 INFO:teuthology.orchestra.run.smithi106.stdout:2951a06464bf41f6a3bf91594147ecff-0-rescue.conf 2021-02-06T22:42:30.699 INFO:teuthology.orchestra.run.smithi106.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.28.1.el8_2.x86_64.conf 2021-02-06T22:42:30.700 INFO:teuthology.orchestra.run.smithi106.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-193.el8.x86_64.conf 2021-02-06T22:42:30.700 INFO:teuthology.orchestra.run.smithi106.stdout:2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64.conf 2021-02-06T22:42:30.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo grub2-set-default 2951a06464bf41f6a3bf91594147ecff-4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:42:30.861 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2021-02-06T22:43:00.879 INFO:teuthology.misc:Re-opening connections... 2021-02-06T22:43:00.879 INFO:teuthology.misc:trying to connect to ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:43:00.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:43:00.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:43:35.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.51 2021-02-06T22:43:35.491 INFO:teuthology.misc:trying to connect to ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:43:35.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:43:35.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:43:53.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2021-02-06T22:43:55.168 DEBUG:teuthology.misc:waited 54.28810715675354 2021-02-06T22:43:56.169 INFO:teuthology.misc:trying to connect to ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:43:56.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:43:56.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:43:59.455 DEBUG:teuthology.orchestra.run.smithi051:> true 2021-02-06T22:43:59.877 DEBUG:teuthology.misc:waited 58.99769878387451 2021-02-06T22:44:00.878 INFO:teuthology.misc:trying to connect to ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:44:00.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:44:00.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:44:03.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2021-02-06T22:44:03.943 DEBUG:teuthology.misc:waited 63.063687562942505 2021-02-06T22:44:04.944 INFO:teuthology.misc:trying to connect to ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:44:04.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:44:04.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:44:05.329 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-02-06T22:44:05.685 DEBUG:teuthology.misc:waited 64.80526781082153 2021-02-06T22:44:06.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-02-06T22:44:06.687 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-06T22:44:06.687 DEBUG:teuthology.orchestra.run.smithi051:> uname -r 2021-02-06T22:44:06.705 INFO:teuthology.orchestra.run.smithi051.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:44:06.705 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:44:06.705 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-06T22:44:06.706 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-06T22:44:06.706 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-02-06T22:44:06.706 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-240.10.1.el8_3.x86_64"... 2021-02-06T22:44:06.707 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2021-02-06T22:44:06.722 INFO:teuthology.orchestra.run.smithi106.stdout:4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:44:06.723 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-240.10.1.el8_3.x86_64 vs 4.18.0-240.10.1.el8_3.x86_64 2021-02-06T22:44:06.723 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-06T22:44:06.723 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-02-06T22:44:07.724 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-02-06T22:44:07.725 DEBUG:teuthology.orchestra.run.smithi051:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-06T22:44:07.848 INFO:teuthology.orchestra.run.smithi051.stdout:ttyS1 2021-02-06T22:44:07.864 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-02-06T22:44:07.865 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-06T22:44:07.925 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2021-02-06T22:44:07.954 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-06T22:44:07.964 INFO:teuthology.task.internal:Creating test directory... 2021-02-06T22:44:07.966 DEBUG:teuthology.orchestra.run.smithi051:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-06T22:44:07.969 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-06T22:44:07.985 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-06T22:44:07.997 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-06T22:44:08.021 INFO:teuthology.task.internal:Creating archive directory... 2021-02-06T22:44:08.022 DEBUG:teuthology.orchestra.run.smithi051:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-06T22:44:08.026 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-06T22:44:08.179 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-06T22:44:08.189 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-06T22:44:08.189 DEBUG:teuthology.orchestra.run.smithi051:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-06T22:44:08.192 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-06T22:44:08.217 INFO:teuthology.orchestra.run.smithi051.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-06T22:44:08.228 INFO:teuthology.orchestra.run.smithi051.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-06T22:44:08.250 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-06T22:44:08.262 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-06T22:44:08.263 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-06T22:44:08.273 INFO:teuthology.task.internal:Configuring sudo... 2021-02-06T22:44:08.274 DEBUG:teuthology.orchestra.run.smithi051:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-06T22:44:08.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-06T22:44:08.302 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-06T22:44:08.318 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-06T22:44:08.319 DEBUG:teuthology.orchestra.run.smithi051:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-06T22:44:08.345 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-06T22:44:08.360 DEBUG:teuthology.orchestra.run.smithi051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-06T22:44:08.436 DEBUG:teuthology.orchestra.run.smithi051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-06T22:44:08.514 DEBUG:teuthology.orchestra.run.smithi051:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-06T22:44:08.549 DEBUG:teuthology.orchestra.run.smithi051:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-06T22:44:08.600 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:44:08.601 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-06T22:44:08.668 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-06T22:44:08.701 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-06T22:44:08.764 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-06T22:44:08.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-06T22:44:08.887 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:44:08.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-06T22:44:08.956 DEBUG:teuthology.orchestra.run.smithi051:> sudo service rsyslog restart 2021-02-06T22:44:08.984 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2021-02-06T22:44:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-06T22:44:09.252 INFO:teuthology.orchestra.run.smithi051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-06T22:44:09.486 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-06T22:44:09.496 INFO:teuthology.task.internal:Starting timer... 2021-02-06T22:44:09.497 INFO:teuthology.run_tasks:Running task pcp... 2021-02-06T22:44:09.534 INFO:teuthology.run_tasks:Running task selinux... 2021-02-06T22:44:09.566 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-02-06T22:44:09.566 DEBUG:teuthology.orchestra.run.smithi051:> sudo service auditd rotate 2021-02-06T22:44:09.983 INFO:teuthology.orchestra.run.smithi051.stdout:Rotating logs: [ OK ] 2021-02-06T22:44:09.995 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2021-02-06T22:44:10.066 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: [ OK ] 2021-02-06T22:44:10.067 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-06T22:44:10.068 DEBUG:teuthology.orchestra.run.smithi051:> /usr/sbin/getenforce 2021-02-06T22:44:10.289 INFO:teuthology.orchestra.run.smithi051.stdout:Permissive 2021-02-06T22:44:10.289 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2021-02-06T22:44:10.350 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2021-02-06T22:44:10.351 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi051.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi106.front.sepia.ceph.com': 'permissive'} 2021-02-06T22:44:10.352 DEBUG:teuthology.orchestra.run.smithi051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-06T22:44:10.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:44:10.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-06T22:44:10.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:44:10.511 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-06T22:44:10.511 DEBUG:teuthology.orchestra.run.smithi051:> sudo /usr/sbin/setenforce permissive 2021-02-06T22:44:10.539 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2021-02-06T22:44:10.573 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-06T22:44:10.583 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-02-06T22:44:10.584 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-06T22:44:10.600 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-06T22:44:10.601 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi051.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-06T22:44:10.925 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-06T22:44:11.817 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-06T22:44:14.364 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-06T22:44:14.383 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:14 +0000 (0:00:00.068) 0:00:00.068 ***** 2021-02-06T22:44:14.396 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:14 +0000 (0:00:00.012) 0:00:00.081 ***** 2021-02-06T22:44:15.937 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi051.front.sepia.ceph.com] 2021-02-06T22:44:16.007 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:16 +0000 (0:00:01.611) 0:00:01.692 ***** 2021-02-06T22:44:16.323 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-06T22:44:16.325 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-06T22:44:16.355 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:16 +0000 (0:00:00.348) 0:00:02.040 ***** 2021-02-06T22:44:16.447 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi106.front.sepia.ceph.com] 2021-02-06T22:44:16.522 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:16 +0000 (0:00:00.166) 0:00:02.207 ***** 2021-02-06T22:44:16.778 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-06T22:44:16.779 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-06T22:44:16.815 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:16 +0000 (0:00:00.292) 0:00:02.500 ***** 2021-02-06T22:44:16.842 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-06T22:44:16.844 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:16.876 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:16 +0000 (0:00:00.060) 0:00:02.561 ***** 2021-02-06T22:44:17.171 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-06T22:44:17.173 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-06T22:44:17.206 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:17 +0000 (0:00:00.329) 0:00:02.891 ***** 2021-02-06T22:44:17.211 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-02-06T22:44:17.213 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:44:17.247 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:17 +0000 (0:00:00.041) 0:00:02.932 ***** 2021-02-06T22:44:17.625 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-06T22:44:17.627 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-06T22:44:17.664 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:17 +0000 (0:00:00.417) 0:00:03.349 ***** 2021-02-06T22:44:17.690 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-06T22:44:17.692 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:17.724 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:17 +0000 (0:00:00.060) 0:00:03.409 ***** 2021-02-06T22:44:17.907 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:44:17.941 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:17 +0000 (0:00:00.217) 0:00:03.626 ***** 2021-02-06T22:44:18.195 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-02-06T22:44:18.197 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651457.2595227-256336005174666/source", "state": "file", "uid": 0} 2021-02-06T22:44:18.231 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:18 +0000 (0:00:00.289) 0:00:03.916 ***** 2021-02-06T22:44:18.662 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-06T22:44:18.664 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-02-06T22:44:18.665 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-06T22:44:18.814 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651457.954917-208920786271175/source", "state": "file", "uid": 0} 2021-02-06T22:44:18.846 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:18 +0000 (0:00:00.614) 0:00:04.531 ***** 2021-02-06T22:44:19.111 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-06T22:44:19.112 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-02-06T22:44:19.114 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-06T22:44:19.207 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-06T22:44:19.214 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-06T22:44:19.363 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:19 +0000 (0:00:00.517) 0:00:05.048 ***** 2021-02-06T22:44:19.394 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:19 +0000 (0:00:00.030) 0:00:05.079 ***** 2021-02-06T22:44:20.037 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi051.front.sepia.ceph.com] 2021-02-06T22:44:20.046 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-02-06T22:44:20.141 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-06T22:44:20.143 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.747) 0:00:05.826 ***** 2021-02-06T22:44:20.176 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.034) 0:00:05.861 ***** 2021-02-06T22:44:20.576 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-06T22:44:20.577 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.133892", "end": "2021-02-06 22:44:20.551426", "rc": 0, "start": "2021-02-06 22:44:20.417534", "stderr": "", "stderr_lines": [], "stdout": "2470ca37c45480b983e40a390839e1c5ce065bc7", "stdout_lines": ["2470ca37c45480b983e40a390839e1c5ce065bc7"]} changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.139107", "end": "2021-02-06 22:44:20.554525", "rc": 0, "start": "2021-02-06 22:44:20.415418", "stderr": "", "stderr_lines": [], "stdout": "2470ca37c45480b983e40a390839e1c5ce065bc7", "stdout_lines": ["2470ca37c45480b983e40a390839e1c5ce065bc7"]} 2021-02-06T22:44:20.609 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.432) 0:00:06.294 ***** 2021-02-06T22:44:20.639 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.029) 0:00:06.324 ***** 2021-02-06T22:44:20.810 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-06T22:44:20.812 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008672", "end": "2021-02-06 22:44:20.792673", "failed_when_result": false, "rc": 0, "start": "2021-02-06 22:44:20.784001", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-02-06T22:44:20.849 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.210) 0:00:06.534 ***** 2021-02-06T22:44:20.856 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009145", "end": "2021-02-06 22:44:20.817517", "failed_when_result": false, "rc": 0, "start": "2021-02-06 22:44:20.808372", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-02-06T22:44:20.893 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.043) 0:00:06.578 ***** 2021-02-06T22:44:20.898 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-06T22:44:20.900 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:20.934 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.041) 0:00:06.619 ***** 2021-02-06T22:44:20.940 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:20.982 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:20 +0000 (0:00:00.047) 0:00:06.667 ***** 2021-02-06T22:44:20.989 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-06T22:44:20.991 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.029 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.047) 0:00:06.714 ***** 2021-02-06T22:44:21.036 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.071 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.041) 0:00:06.756 ***** 2021-02-06T22:44:21.077 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-06T22:44:21.078 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.112 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.040) 0:00:06.797 ***** 2021-02-06T22:44:21.118 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.152 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.040) 0:00:06.837 ***** 2021-02-06T22:44:21.158 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-06T22:44:21.160 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.193 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.040) 0:00:06.878 ***** 2021-02-06T22:44:21.199 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.233 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.040) 0:00:06.918 ***** 2021-02-06T22:44:21.238 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-06T22:44:21.240 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.274 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.041) 0:00:06.959 ***** 2021-02-06T22:44:21.280 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:21.314 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.039) 0:00:06.999 ***** 2021-02-06T22:44:21.476 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-06T22:44:21.477 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:44:21.511 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.196) 0:00:07.196 ***** 2021-02-06T22:44:21.517 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:44:21.552 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:21 +0000 (0:00:00.041) 0:00:07.237 ***** 2021-02-06T22:44:21.755 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-06T22:44:21.757 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-06T22:44:21.787 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-06T22:44:21.946 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-06T22:44:21.979 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-06T22:44:22.146 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-06T22:44:22.168 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-06T22:44:22.347 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-06T22:44:22.369 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-06T22:44:22.545 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-06T22:44:22.567 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-06T22:44:22.751 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-06T22:44:22.753 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-06T22:44:22.943 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-06T22:44:22.955 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-06T22:44:23.133 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-06T22:44:23.156 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-06T22:44:23.324 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-06T22:44:23.357 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-06T22:44:23.514 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-06T22:44:23.557 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-06T22:44:23.704 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-06T22:44:23.756 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-06T22:44:23.892 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-06T22:44:23.955 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-06T22:44:24.081 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-06T22:44:24.155 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-06T22:44:24.281 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-06T22:44:24.365 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-06T22:44:24.470 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-06T22:44:24.564 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-06T22:44:24.659 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-06T22:44:24.775 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-06T22:44:24.848 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-06T22:44:24.975 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-06T22:44:25.038 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-06T22:44:25.173 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-06T22:44:25.227 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-06T22:44:25.373 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-06T22:44:25.415 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-06T22:44:25.572 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-06T22:44:25.605 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-06T22:44:25.774 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-06T22:44:25.796 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-06T22:44:25.974 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-06T22:44:25.985 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-06T22:44:26.173 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-06T22:44:26.174 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-06T22:44:26.363 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-06T22:44:26.375 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-06T22:44:26.552 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-06T22:44:26.584 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-06T22:44:26.742 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-06T22:44:26.788 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-06T22:44:26.925 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-06T22:44:26.989 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-06T22:44:26.991 INFO:teuthology.task.ansible.out: 2021-02-06T22:44:27.116 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-06T22:44:27.191 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-06T22:44:27.308 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-06T22:44:27.381 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-06T22:44:27.498 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-06T22:44:27.582 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-06T22:44:27.687 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-06T22:44:27.781 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-06T22:44:27.876 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-06T22:44:27.981 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-06T22:44:28.066 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-06T22:44:28.181 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-06T22:44:28.257 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-06T22:44:28.383 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-06T22:44:28.447 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-06T22:44:28.582 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-06T22:44:28.636 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-06T22:44:28.781 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-06T22:44:28.824 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-06T22:44:28.981 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-06T22:44:29.013 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-06T22:44:29.179 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-06T22:44:29.201 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-06T22:44:29.378 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-06T22:44:29.390 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-06T22:44:29.578 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-06T22:44:29.579 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-06T22:44:29.777 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-06T22:44:29.789 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-06T22:44:29.966 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-06T22:44:29.977 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-06T22:44:30.166 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-06T22:44:30.177 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-06T22:44:30.355 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-06T22:44:30.377 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-06T22:44:30.544 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-06T22:44:30.586 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-06T22:44:30.733 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-06T22:44:30.786 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-06T22:44:30.921 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-06T22:44:30.985 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-06T22:44:31.111 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-06T22:44:31.185 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-06T22:44:31.300 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-06T22:44:31.384 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-06T22:44:31.489 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-06T22:44:31.584 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-06T22:44:31.680 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-06T22:44:31.787 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-06T22:44:31.871 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-06T22:44:31.986 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-06T22:44:32.061 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-06T22:44:32.189 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-06T22:44:32.243 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-06T22:44:32.390 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-06T22:44:32.443 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-06T22:44:32.601 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-06T22:44:32.622 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-06T22:44:32.794 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-06T22:44:32.817 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-06T22:44:32.996 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-06T22:44:33.009 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-06T22:44:33.191 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-06T22:44:33.202 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-06T22:44:33.380 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-06T22:44:33.402 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-06T22:44:33.580 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-06T22:44:33.591 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-06T22:44:33.768 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-06T22:44:33.801 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-06T22:44:33.956 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-06T22:44:34.001 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-06T22:44:34.147 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-06T22:44:34.199 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-06T22:44:34.334 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-06T22:44:34.398 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-06T22:44:34.523 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-06T22:44:34.596 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-06T22:44:34.722 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-06T22:44:34.796 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-06T22:44:34.911 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-06T22:44:34.985 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-06T22:44:35.101 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-06T22:44:35.186 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-06T22:44:35.290 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-06T22:44:35.395 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-06T22:44:35.479 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-06T22:44:35.594 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-06T22:44:35.667 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-06T22:44:35.793 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-06T22:44:35.856 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-06T22:44:35.993 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-06T22:44:36.047 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-06T22:44:36.193 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-06T22:44:36.247 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-06T22:44:36.393 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-06T22:44:36.436 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-06T22:44:36.593 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-06T22:44:36.615 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-06T22:44:36.793 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-06T22:44:36.815 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-06T22:44:36.993 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-06T22:44:37.005 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-06T22:44:37.193 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-06T22:44:37.194 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-06T22:44:37.381 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-06T22:44:37.392 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-06T22:44:37.571 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-06T22:44:37.593 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-06T22:44:37.759 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-06T22:44:37.781 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-06T22:44:37.949 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-06T22:44:37.981 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-06T22:44:38.138 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-06T22:44:38.180 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-06T22:44:38.327 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-06T22:44:38.379 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-06T22:44:38.515 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-06T22:44:38.580 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-06T22:44:38.707 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-06T22:44:38.709 INFO:teuthology.task.ansible.out: 2021-02-06T22:44:38.781 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-06T22:44:38.897 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-06T22:44:38.982 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-06T22:44:39.087 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-06T22:44:39.183 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-06T22:44:39.279 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-06T22:44:39.384 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-06T22:44:39.468 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-06T22:44:39.584 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-06T22:44:39.668 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-06T22:44:39.783 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-06T22:44:39.857 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-06T22:44:39.986 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-06T22:44:40.051 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-06T22:44:40.188 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-06T22:44:40.251 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-06T22:44:40.387 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-06T22:44:40.440 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-06T22:44:40.579 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-06T22:44:40.622 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-06T22:44:40.789 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-06T22:44:40.811 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-06T22:44:40.979 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-06T22:44:41.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-06T22:44:41.179 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-06T22:44:41.201 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-06T22:44:41.378 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-06T22:44:41.389 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-06T22:44:41.578 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-06T22:44:41.579 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-06T22:44:41.776 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-06T22:44:41.777 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-06T22:44:41.965 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-06T22:44:41.977 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-06T22:44:42.148 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-06T22:44:42.181 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-06T22:44:42.338 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-06T22:44:42.381 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-06T22:44:42.528 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-06T22:44:42.581 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-06T22:44:42.583 INFO:teuthology.task.ansible.out: 2021-02-06T22:44:42.717 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-06T22:44:42.781 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-06T22:44:42.913 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-06T22:44:42.976 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-06T22:44:43.091 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-06T22:44:43.175 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-06T22:44:43.290 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-06T22:44:43.374 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-06T22:44:43.479 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-06T22:44:43.573 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-06T22:44:43.668 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-06T22:44:43.774 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-06T22:44:43.858 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-06T22:44:43.974 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-06T22:44:44.048 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-06T22:44:44.174 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-06T22:44:44.248 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-06T22:44:44.374 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-06T22:44:44.438 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-06T22:44:44.573 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-06T22:44:44.626 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-06T22:44:44.783 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-06T22:44:44.826 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-06T22:44:44.983 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-06T22:44:45.015 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-06T22:44:45.192 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-06T22:44:45.203 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-06T22:44:45.392 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-06T22:44:45.392 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-06T22:44:45.581 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-06T22:44:45.592 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-06T22:44:45.780 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-06T22:44:45.791 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-06T22:44:45.969 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-06T22:44:45.992 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-06T22:44:46.159 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-06T22:44:46.192 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-06T22:44:46.350 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-06T22:44:46.393 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-06T22:44:46.540 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-06T22:44:46.592 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-06T22:44:46.729 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-06T22:44:46.793 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-06T22:44:46.918 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-06T22:44:46.992 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-06T22:44:47.107 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-06T22:44:47.191 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-06T22:44:47.297 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-06T22:44:47.402 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-06T22:44:47.600 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-06T22:44:47.799 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-06T22:44:47.999 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-06T22:44:48.197 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-06T22:44:48.397 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-06T22:44:48.605 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-06T22:44:48.998 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-06T22:44:50.278 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-06T22:44:50.446 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-06T22:44:51.617 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-06T22:44:51.732 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:51 +0000 (0:00:30.180) 0:00:37.417 ***** 2021-02-06T22:44:51.758 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-06T22:44:51.791 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:51 +0000 (0:00:00.058) 0:00:37.476 ***** 2021-02-06T22:44:51.798 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-06T22:44:51.799 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-06T22:44:51.832 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-06T22:44:51.835 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-06T22:44:51.836 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-06T22:44:51.838 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-06T22:44:51.839 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-06T22:44:51.841 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-06T22:44:51.842 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-06T22:44:51.844 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-06T22:44:51.846 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-06T22:44:51.847 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-06T22:44:51.849 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-06T22:44:51.851 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-06T22:44:51.852 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-06T22:44:51.854 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395 2021-02-06T22:44:51.854 INFO:teuthology.task.ansible.out:862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}]}, "changed": false} 2021-02-06T22:44:51.895 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:51 +0000 (0:00:00.103) 0:00:37.580 ***** 2021-02-06T22:44:52.657 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-06T22:44:52.659 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com -> localhost] => {"after": "2470ca37c45480b983e40a390839e1c5ce065bc7", "attempts": 1, "before": "2470ca37c45480b983e40a390839e1c5ce065bc7", "changed": false, "remote_url_changed": false} 2021-02-06T22:44:52.691 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:52 +0000 (0:00:00.796) 0:00:38.376 ***** 2021-02-06T22:44:52.967 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-06T22:44:53.186 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-06T22:44:53.238 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-06T22:44:53.240 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-06T22:44:53.355 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:53 +0000 (0:00:00.664) 0:00:39.040 ***** 2021-02-06T22:44:53.381 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-06T22:44:53.415 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:53 +0000 (0:00:00.059) 0:00:39.100 ***** 2021-02-06T22:44:53.421 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:44:53.422 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-06T22:44:53.456 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-06T22:44:53.457 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-02-06T22:44:53.459 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-02-06T22:44:53.461 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2021-02-06T22:44:53.462 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1Wi 2021-02-06T22:44:53.464 INFO:teuthology.task.ansible.out:RenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vum 2021-02-06T22:44:53.466 INFO:teuthology.task.ansible.out:rao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69 2021-02-06T22:44:53.467 INFO:teuthology.task.ansible.out:mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 2021-02-06T22:44:53.468 INFO:teuthology.task.ansible.out:5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d8 2021-02-06T22:44:53.469 INFO:teuthology.task.ansible.out:41a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveirada 2021-02-06T22:44:53.471 INFO:teuthology.task.ansible.out:n@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOe 2021-02-06T22:44:53.473 INFO:teuthology.task.ansible.out:nVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9 2021-02-06T22:44:53.474 INFO:teuthology.task.ansible.out:gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": 2021-02-06T22:44:53.476 INFO:teuthology.task.ansible.out:"dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NI 2021-02-06T22:44:53.477 INFO:teuthology.task.ansible.out:Nj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395 2021-02-06T22:44:53.478 INFO:teuthology.task.ansible.out:862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}]}, "changed": false} 2021-02-06T22:44:53.519 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:53 +0000 (0:00:00.104) 0:00:39.204 ***** 2021-02-06T22:44:53.608 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:44:53.610 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-06T22:44:53.612 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-06T22:44:53.818 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-06T22:44:54.027 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-06T22:44:54.029 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} TASK [users : Clone the keys repo] ********************************************* ok: [smithi051.front.sepia.ceph.com -> localhost] => {"after": "2470ca37c45480b983e40a390839e1c5ce065bc7", "attempts": 1, "before": "2470ca37c45480b983e40a390839e1c5ce065bc7", "changed": false, "remote_url_changed": false} 2021-02-06T22:44:54.061 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:44:54 +0000 (0:00:00.541) 0:00:39.746 ***** 2021-02-06T22:44:54.243 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:44:54.245 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-06T22:44:54.369 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-06T22:44:54.453 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-06T22:44:54.589 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-06T22:44:54.663 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-06T22:44:54.673 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:54.820 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-06T22:44:54.883 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-06T22:44:54.885 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-06T22:44:55.039 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-02-06T22:44:55.041 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-06T22:44:55.092 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-06T22:44:55.094 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-06T22:44:55.103 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:55.114 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:55.262 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-06T22:44:55.264 INFO:teuthology.task.ansible.out: 2021-02-06T22:44:55.327 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-06T22:44:55.484 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-02-06T22:44:55.486 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-06T22:44:55.537 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-06T22:44:55.539 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-06T22:44:55.704 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-06T22:44:55.747 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-06T22:44:55.924 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-06T22:44:55.956 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-06T22:44:56.144 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-06T22:44:56.155 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:56.166 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-06T22:44:56.377 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-06T22:44:56.399 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-02-06T22:44:56.401 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-06T22:44:56.588 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-06T22:44:56.621 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-02-06T22:44:56.622 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-02-06T22:44:56.632 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:56.634 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:44:56.800 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-06T22:44:56.802 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-06T22:44:56.852 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-06T22:44:57.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-06T22:44:57.014 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-06T22:44:57.076 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-02-06T22:44:57.078 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-06T22:44:57.213 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-06T22:44:57.320 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-06T22:44:57.427 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-06T22:44:57.553 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-06T22:44:57.638 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-06T22:44:57.640 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-06T22:44:57.766 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-06T22:44:57.850 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-06T22:44:57.997 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-06T22:44:58.060 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-06T22:44:58.219 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-06T22:44:58.272 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-06T22:44:58.440 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-02-06T22:44:58.441 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-06T22:44:58.482 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-06T22:44:58.674 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-02-06T22:44:58.676 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-06T22:44:58.696 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-06T22:44:58.899 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-06T22:44:58.911 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-06T22:44:58.913 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-06T22:44:59.112 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-06T22:44:59.123 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-06T22:44:59.332 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-06T22:45:03.860 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2021-02-06T22:45:03.862 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": 2021-02-06T22:45:03.863 INFO:teuthology.task.ansible.out: "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV 2021-02-06T22:45:03.865 INFO:teuthology.task.ansible.out:2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1q 2021-02-06T22:45:03.867 INFO:teuthology.task.ansible.out:Prv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ck 2021-02-06T22:45:03.868 INFO:teuthology.task.ansible.out:vCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a8 2021-02-06T22:45:03.870 INFO:teuthology.task.ansible.out:1fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "c 2021-02-06T22:45:03.872 INFO:teuthology.task.ansible.out:omment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10 2021-02-06T22:45:03.872 INFO:teuthology.task.ansible.out:aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-06T22:45:03.874 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-02-06T22:45:03.875 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_ 2021-02-06T22:45:03.877 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1 2021-02-06T22:45:03.879 INFO:teuthology.task.ansible.out:D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_op 2021-02-06T22:45:03.880 INFO:teuthology.task.ansible.out:tions": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAA 2021-02-06T22:45:03.882 INFO:teuthology.task.ansible.out:B3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsS 2021-02-06T22:45:03.884 INFO:teuthology.task.ansible.out:Sh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU 2021-02-06T22:45:03.886 INFO:teuthology.task.ansible.out:8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null 2021-02-06T22:45:03.888 INFO:teuthology.task.ansible.out:, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "ex 2021-02-06T22:45:03.890 INFO:teuthology.task.ansible.out:clusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2E 2021-02-06T22:45:03.891 INFO:teuthology.task.ansible.out:AAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECx 2021-02-06T22:45:03.893 INFO:teuthology.task.ansible.out:kurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCs 2021-02-06T22:45:03.895 INFO:teuthology.task.ansible.out:j5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0 2021-02-06T22:45:03.896 INFO:teuthology.task.ansible.out:LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive" 2021-02-06T22:45:03.898 INFO:teuthology.task.ansible.out:: false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu 2021-02-06T22:45:03.899 INFO:teuthology.task.ansible.out:5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-06T22:45:03.900 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:03.902 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-02-06T22:45:03.903 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zp 2021-02-06T22:45:03.905 INFO:teuthology.task.ansible.out:Oc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hC 2021-02-06T22:45:03.906 INFO:teuthology.task.ansible.out:ps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdD 2021-02-06T22:45:03.908 INFO:teuthology.task.ansible.out:mjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4 2021-02-06T22:45:03.910 INFO:teuthology.task.ansible.out:swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLU 2021-02-06T22:45:03.911 INFO:teuthology.task.ansible.out:XMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19Fs 2021-02-06T22:45:03.913 INFO:teuthology.task.ansible.out:JSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-06T22:45:03.939 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-06T22:45:03.971 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2021-02-06T22:45:03.973 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-06T22:45:04.163 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-06T22:45:04.165 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-02-06T22:45:04.196 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-02-06T22:45:04.197 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-02-06T22:45:04.199 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-06T22:45:04.379 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-06T22:45:04.423 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-06T22:45:04.591 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-06T22:45:04.645 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-06T22:45:04.802 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-06T22:45:04.804 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-06T22:45:04.866 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-06T22:45:05.004 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-06T22:45:05.088 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-06T22:45:05.225 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-06T22:45:05.310 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-06T22:45:05.436 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-06T22:45:05.531 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-02-06T22:45:05.533 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-06T22:45:05.637 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-06T22:45:05.753 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-06T22:45:05.859 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-06T22:45:05.975 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-06T22:45:06.059 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-06T22:45:06.195 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-02-06T22:45:06.197 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-02-06T22:45:06.269 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-06T22:45:06.416 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-06T22:45:06.481 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-06T22:45:06.638 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-06T22:45:06.691 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-06T22:45:06.869 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-02-06T22:45:06.870 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-06T22:45:06.890 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-06T22:45:06.892 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:07.089 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-06T22:45:07.101 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-06T22:45:07.313 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "val 2021-02-06T22:45:07.314 INFO:teuthology.task.ansible.out:idate_certs": true} 2021-02-06T22:45:07.521 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-06T22:45:07.532 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-06T22:45:07.732 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-06T22:45:07.743 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-06T22:45:07.942 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-06T22:45:07.964 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-06T22:45:08.142 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-06T22:45:08.185 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-06T22:45:08.353 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-06T22:45:08.405 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-06T22:45:08.574 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-06T22:45:08.627 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-06T22:45:08.784 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-06T22:45:08.858 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-06T22:45:08.994 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-06T22:45:09.079 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-06T22:45:09.195 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-06T22:45:09.197 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-06T22:45:09.300 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-06T22:45:09.407 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-06T22:45:09.512 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-06T22:45:09.617 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-06T22:45:09.734 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-06T22:45:09.819 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-06T22:45:09.976 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-06T22:45:10.030 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-06T22:45:10.189 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-06T22:45:10.253 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-06T22:45:10.255 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-06T22:45:10.410 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-06T22:45:10.454 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-06T22:45:10.456 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-06T22:45:10.633 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-06T22:45:10.676 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-06T22:45:10.855 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-06T22:45:10.887 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-06T22:45:11.086 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-06T22:45:11.097 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-06T22:45:11.306 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-06T22:45:11.308 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-06T22:45:11.526 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-06T22:45:11.538 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-02-06T22:45:11.540 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-06T22:45:11.727 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-06T22:45:11.749 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-06T22:45:11.936 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-06T22:45:11.969 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-06T22:45:12.148 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-06T22:45:12.150 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-06T22:45:12.201 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-06T22:45:12.359 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-06T22:45:12.425 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-06T22:45:12.562 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-06T22:45:12.636 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-02-06T22:45:12.638 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-06T22:45:12.773 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-06T22:45:12.868 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-02-06T22:45:12.870 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-06T22:45:12.985 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-06T22:45:13.100 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-06T22:45:13.196 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-06T22:45:13.332 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-06T22:45:13.396 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-06T22:45:13.564 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-06T22:45:13.607 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-06T22:45:13.609 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-06T22:45:13.785 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-06T22:45:13.818 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-06T22:45:14.016 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-06T22:45:14.027 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-06T22:45:14.235 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-06T22:45:14.246 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-06T22:45:14.456 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-06T22:45:14.457 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-06T22:45:14.665 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-06T22:45:14.676 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-02-06T22:45:14.678 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-06T22:45:14.875 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-06T22:45:14.897 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-06T22:45:15.096 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-06T22:45:15.119 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-06T22:45:15.309 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-06T22:45:15.341 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-06T22:45:15.519 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-06T22:45:15.561 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-06T22:45:15.729 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-06T22:45:15.782 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-06T22:45:15.940 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-06T22:45:15.993 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-06T22:45:16.160 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-06T22:45:16.214 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2021-02-06T22:45:16.216 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-06T22:45:16.374 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-06T22:45:16.437 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-06T22:45:16.584 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-06T22:45:16.647 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-06T22:45:16.793 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-06T22:45:16.877 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-06T22:45:17.003 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-06T22:45:17.098 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-06T22:45:17.216 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-06T22:45:17.322 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-06T22:45:17.427 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-06T22:45:17.542 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-06T22:45:17.637 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-06T22:45:17.639 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-06T22:45:17.766 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-06T22:45:17.863 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-06T22:45:18.000 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-06T22:45:18.073 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-06T22:45:18.222 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-06T22:45:18.287 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-06T22:45:18.447 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-06T22:45:18.500 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-06T22:45:18.667 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-06T22:45:18.700 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-06T22:45:18.879 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-06T22:45:18.880 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:18.912 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-06T22:45:19.110 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-06T22:45:19.131 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-06T22:45:19.330 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-06T22:45:19.341 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-06T22:45:19.551 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-06T22:45:19.552 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-06T22:45:19.763 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-06T22:45:19.774 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-06T22:45:19.964 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-06T22:45:20.006 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-06T22:45:20.184 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-06T22:45:20.227 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-06T22:45:20.385 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-06T22:45:20.449 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-02-06T22:45:20.450 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-06T22:45:20.607 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-06T22:45:20.670 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-06T22:45:20.817 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-06T22:45:20.890 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-06T22:45:21.026 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-06T22:45:21.120 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-06T22:45:21.246 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-06T22:45:21.322 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:21 +0000 (0:00:27.261) 0:01:07.007 ***** 2021-02-06T22:45:21.340 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-06T22:45:21.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:21.364 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.374 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.386 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.398 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.409 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.421 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.422 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.433 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.444 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.559 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:21.561 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-06T22:45:21.665 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:21.667 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-06T22:45:21.677 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.678 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:21.783 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:21.785 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-06T22:45:21.888 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:21.889 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-06T22:45:22.003 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:22.005 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-06T22:45:22.099 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:22.101 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-06T22:45:22.110 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.112 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.122 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.133 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.135 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.145 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.156 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.157 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.167 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.178 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.189 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.191 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.200 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.211 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.212 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.222 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.233 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.235 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional 2021-02-06T22:45:22.237 INFO:teuthology.task.ansible.out: result was False"} 2021-02-06T22:45:22.245 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.256 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.258 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.267 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.278 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.279 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.289 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.300 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.301 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.311 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.323 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.324 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.335 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.337 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.348 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.359 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.361 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.371 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.382 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.393 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.394 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.404 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.415 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.417 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.427 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.438 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.439 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.449 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.461 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-06T22:45:22.463 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.473 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.484 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.485 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.496 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.507 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.509 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.519 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.530 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.532 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.541 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.552 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.554 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.563 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.574 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.585 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.596 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.607 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.609 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.618 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.629 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.640 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.641 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.651 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.662 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.673 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.674 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.685 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.687 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.696 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.707 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.709 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.718 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.729 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.731 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.740 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.751 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.762 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.766 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.776 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.787 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.789 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.799 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.810 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.811 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.821 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.832 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.834 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.843 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.854 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.857 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.866 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.877 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.878 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.890 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-06T22:45:22.902 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.911 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.913 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.922 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.933 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.945 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.948 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.956 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.967 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.969 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.979 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.990 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:22.992 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.002 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.012 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.014 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.024 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.035 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.037 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.046 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.057 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.108 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:23 +0000 (0:00:01.786) 0:01:08.793 ***** 2021-02-06T22:45:23.125 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:23.127 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-06T22:45:23.136 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-06T22:45:23.138 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:23.170 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:23 +0000 (0:00:00.061) 0:01:08.855 ***** 2021-02-06T22:45:23.355 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:23.357 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-06T22:45:23.398 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:23.400 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-06T22:45:23.578 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-06T22:45:23.610 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:23.612 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-06T22:45:23.770 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:23.772 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-06T22:45:23.824 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:23.826 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-06T22:45:23.953 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:23.954 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-06T22:45:24.048 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:24.050 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-06T22:45:24.133 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:24.135 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-06T22:45:24.280 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-06T22:45:24.282 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-06T22:45:24.336 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:24.338 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-06T22:45:24.374 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:24 +0000 (0:00:01.204) 0:01:10.059 ***** 2021-02-06T22:45:24.416 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:24.418 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.428 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.439 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.441 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.451 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.462 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.464 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.473 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.484 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.506 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:24.508 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-06T22:45:24.697 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-06T22:45:24.709 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:24.711 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-06T22:45:24.721 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.732 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:24.881 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:24.883 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-06T22:45:24.944 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:24.947 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-06T22:45:25.072 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:25.074 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-06T22:45:25.167 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:25.169 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-06T22:45:25.178 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.189 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.191 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.201 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.212 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.212 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.223 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.234 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.245 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.247 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.256 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.258 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi106.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-06T22:45:25.269 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:25.270 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.280 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.291 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.302 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.303 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.313 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.324 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.326 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.336 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.347 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.358 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.360 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.370 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.381 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.383 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.392 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.403 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.405 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.416 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.427 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.438 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.440 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.449 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.451 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi106.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-06T22:45:25.461 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:25.462 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.473 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.484 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.485 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.495 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.506 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.517 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.528 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.539 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.550 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.562 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.573 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.585 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.586 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.597 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.608 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.610 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.620 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.630 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.632 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.642 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.644 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi106.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-06T22:45:25.654 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-02-06T22:45:25.655 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.665 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.676 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.677 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.687 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.698 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.709 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.710 INFO:teuthology.task.ansible.out: skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.721 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.732 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.743 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.754 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.756 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.766 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.776 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.778 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.787 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.798 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.809 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.811 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.821 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.832 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:25.833 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.844 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.855 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.857 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.867 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.877 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.879 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.888 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.900 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.911 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.912 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.922 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.933 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.935 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.944 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.946 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:25.955 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.957 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.967 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.978 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.979 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:25.989 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.000 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.011 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.012 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi106.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.023 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.034 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.035 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.045 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.056 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.066 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.068 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.078 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.090 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.092 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.101 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.112 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.114 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.123 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.134 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.136 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.196 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:26 +0000 (0:00:01.822) 0:01:11.881 ***** 2021-02-06T22:45:26.203 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:26.205 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-06T22:45:26.226 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-06T22:45:26.227 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:26.263 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:26 +0000 (0:00:00.066) 0:01:11.948 ***** 2021-02-06T22:45:26.378 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:26.380 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-06T22:45:26.504 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-06T22:45:26.567 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-06T22:45:26.705 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-06T22:45:26.748 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-06T22:45:26.895 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-06T22:45:26.938 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-06T22:45:27.096 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-06T22:45:27.118 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-06T22:45:27.285 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-06T22:45:27.307 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-06T22:45:27.484 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-06T22:45:27.485 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-06T22:45:27.673 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-06T22:45:27.684 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-06T22:45:27.861 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-06T22:45:27.872 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-06T22:45:28.051 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-06T22:45:28.062 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-06T22:45:28.239 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-06T22:45:28.261 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-06T22:45:28.418 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-06T22:45:28.450 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-06T22:45:28.607 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-06T22:45:28.650 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-06T22:45:28.796 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-06T22:45:28.848 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-06T22:45:28.984 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-06T22:45:29.037 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-06T22:45:29.173 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-06T22:45:29.236 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-06T22:45:29.352 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-06T22:45:29.425 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-06T22:45:29.551 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-06T22:45:29.624 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-06T22:45:29.730 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-06T22:45:29.824 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-06T22:45:29.928 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-06T22:45:30.910 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} ok: [smithi106.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} ok: [smithi051.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} ok: [smithi051.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} ok: [smithi051.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} ok: [smithi051.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-06T22:45:30.991 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-06T22:45:31.188 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-06T22:45:31.334 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-02-06T22:45:31.388 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-06T22:45:31.586 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-06T22:45:31.776 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-06T22:45:31.975 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-06T22:45:32.175 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-06T22:45:32.363 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-06T22:45:32.532 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-06T22:45:32.564 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-06T22:45:32.722 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-06T22:45:32.754 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-06T22:45:32.914 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-06T22:45:32.956 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-06T22:45:33.102 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-06T22:45:33.155 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-06T22:45:33.280 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-06T22:45:33.354 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-06T22:45:33.470 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-06T22:45:33.554 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-06T22:45:33.658 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-06T22:45:33.847 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-06T22:45:34.025 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-06T22:45:34.216 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-06T22:45:34.404 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-06T22:45:34.462 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:34 +0000 (0:00:08.198) 0:01:20.147 ***** 2021-02-06T22:45:34.844 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-02-06T22:45:34.970 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-06T22:45:34.971 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "6bd1cd53e59aef6d9a4a202ec6756843cde9d9e4", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b908bc6436240ef2dee4e6bf56b67554", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651534.490504-257843330246119/source", "state": "file", "uid": 0} 2021-02-06T22:45:35.005 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:34 +0000 (0:00:00.543) 0:01:20.690 ***** 2021-02-06T22:45:35.033 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-06T22:45:35.034 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => { "msg": "Host smithi106.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-06T22:45:35.070 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.064) 0:01:20.754 ***** 2021-02-06T22:45:35.107 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-06T22:45:35.109 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-06T22:45:35.142 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.072) 0:01:20.827 ***** 2021-02-06T22:45:35.179 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-06T22:45:35.181 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:35.213 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.070) 0:01:20.897 ***** 2021-02-06T22:45:35.761 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-06T22:45:35.762 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.353346", "end": "2021-02-06 22:45:35.737894", "rc": 0, "start": "2021-02-06 22:45:35.384548", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-06T22:45:35.794 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.581) 0:01:21.479 ***** 2021-02-06T22:45:35.820 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-06T22:45:35.822 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:35.854 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.060) 0:01:21.539 ***** 2021-02-06T22:45:35.881 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-06T22:45:35.883 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:35.916 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.061) 0:01:21.601 ***** 2021-02-06T22:45:35.953 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-06T22:45:35.955 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:35.985 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:35 +0000 (0:00:00.069) 0:01:21.670 ***** 2021-02-06T22:45:36.012 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-06T22:45:36.014 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.045 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.060) 0:01:21.730 ***** 2021-02-06T22:45:36.072 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-06T22:45:36.073 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.107 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.061) 0:01:21.792 ***** 2021-02-06T22:45:36.144 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-06T22:45:36.146 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.180 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.073) 0:01:21.865 ***** 2021-02-06T22:45:36.217 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-06T22:45:36.219 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:36.252 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.071) 0:01:21.937 ***** 2021-02-06T22:45:36.269 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:36.270 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-06T22:45:36.280 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-06T22:45:36.282 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.316 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.064) 0:01:22.001 ***** 2021-02-06T22:45:36.343 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-06T22:45:36.348 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.377 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.060) 0:01:22.062 ***** 2021-02-06T22:45:36.403 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-06T22:45:36.404 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:36.436 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.058) 0:01:22.121 ***** 2021-02-06T22:45:36.462 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-06T22:45:36.463 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.497 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.060) 0:01:22.182 ***** 2021-02-06T22:45:36.503 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:36.504 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-06T22:45:36.525 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:36.558 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.061) 0:01:22.243 ***** 2021-02-06T22:45:36.585 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-06T22:45:36.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.621 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.062) 0:01:22.306 ***** 2021-02-06T22:45:36.648 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-06T22:45:36.650 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.685 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.063) 0:01:22.370 ***** 2021-02-06T22:45:36.692 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:36.693 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-06T22:45:36.715 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-06T22:45:36.716 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.751 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.066) 0:01:22.436 ***** 2021-02-06T22:45:36.781 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-06T22:45:36.783 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.827 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.076) 0:01:22.512 ***** 2021-02-06T22:45:36.854 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-06T22:45:36.856 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:36.891 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.063) 0:01:22.576 ***** 2021-02-06T22:45:36.897 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:36.898 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-06T22:45:36.920 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:36.954 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:36 +0000 (0:00:00.062) 0:01:22.639 ***** 2021-02-06T22:45:36.980 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.014 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.059) 0:01:22.699 ***** 2021-02-06T22:45:37.040 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-06T22:45:37.042 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.074 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.060) 0:01:22.759 ***** 2021-02-06T22:45:37.081 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:37.082 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-06T22:45:37.114 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-06T22:45:37.116 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.145 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.070) 0:01:22.830 ***** 2021-02-06T22:45:37.172 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-06T22:45:37.174 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.205 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.059) 0:01:22.890 ***** 2021-02-06T22:45:37.241 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-06T22:45:37.242 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.275 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.069) 0:01:22.960 ***** 2021-02-06T22:45:37.281 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:37.282 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-06T22:45:37.313 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-06T22:45:37.315 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:37.348 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.073) 0:01:23.033 ***** 2021-02-06T22:45:37.374 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-06T22:45:37.376 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.408 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.060) 0:01:23.093 ***** 2021-02-06T22:45:37.435 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-06T22:45:37.436 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:37.468 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.060) 0:01:23.153 ***** 2021-02-06T22:45:37.475 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:37.477 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-06T22:45:37.667 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-06T22:45:37.710 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-06T22:45:37.711 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:45:37.749 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:37 +0000 (0:00:00.280) 0:01:23.434 ***** 2021-02-06T22:45:37.861 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-06T22:45:37.863 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-06T22:45:38.061 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-06T22:45:38.261 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-06T22:45:38.330 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:38 +0000 (0:00:00.581) 0:01:24.015 ***** 2021-02-06T22:45:38.497 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-06T22:45:38.864 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-06T22:45:38.866 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "checksum": "6bd1cd53e59aef6d9a4a202ec6756843cde9d9e4", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "b908bc6436240ef2dee4e6bf56b67554", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651538.3562376-192707695061519/source", "state": "file", "uid": 0} 2021-02-06T22:45:38.897 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:38 +0000 (0:00:00.566) 0:01:24.581 ***** 2021-02-06T22:45:38.923 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-06T22:45:38.925 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => { "msg": "Host smithi051.front.sepia.ceph.com is running CentOS 8.2 (Core)" } 2021-02-06T22:45:38.957 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:38 +0000 (0:00:00.060) 0:01:24.642 ***** 2021-02-06T22:45:38.963 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-06T22:45:38.964 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-06T22:45:39.002 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:38 +0000 (0:00:00.045) 0:01:24.687 ***** 2021-02-06T22:45:39.007 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-06T22:45:39.009 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-02-06T22:45:39.043 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.041) 0:01:24.728 ***** 2021-02-06T22:45:39.070 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-06T22:45:39.071 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:39.103 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.059) 0:01:24.788 ***** 2021-02-06T22:45:39.463 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-06T22:45:39.464 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-06T22:45:39.652 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-06T22:45:39.653 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.346704", "end": "2021-02-06 22:45:39.627624", "rc": 0, "start": "2021-02-06 22:45:39.280920", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-06T22:45:39.686 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.583) 0:01:25.371 ***** 2021-02-06T22:45:39.713 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-06T22:45:39.715 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:39.750 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.063) 0:01:25.435 ***** 2021-02-06T22:45:39.776 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-06T22:45:39.778 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:39.810 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.060) 0:01:25.495 ***** 2021-02-06T22:45:39.837 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:39.870 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.059) 0:01:25.555 ***** 2021-02-06T22:45:39.896 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-06T22:45:39.898 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-06T22:45:39.898 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:39.931 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.060) 0:01:25.616 ***** 2021-02-06T22:45:39.965 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:39 +0000 (0:00:00.034) 0:01:25.650 ***** 2021-02-06T22:45:39.971 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-06T22:45:39.972 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.009 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.043) 0:01:25.694 ***** 2021-02-06T22:45:40.019 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-06T22:45:40.020 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.061 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.052) 0:01:25.746 ***** 2021-02-06T22:45:40.070 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-06T22:45:40.072 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.119 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.057) 0:01:25.804 ***** 2021-02-06T22:45:40.125 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-06T22:45:40.127 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.166 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.047) 0:01:25.851 ***** 2021-02-06T22:45:40.174 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-06T22:45:40.176 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:40.212 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.046) 0:01:25.897 ***** 2021-02-06T22:45:40.219 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-06T22:45:40.221 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.257 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.044) 0:01:25.942 ***** 2021-02-06T22:45:40.263 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-06T22:45:40.265 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.306 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.048) 0:01:25.991 ***** 2021-02-06T22:45:40.315 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-06T22:45:40.317 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.351 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.044) 0:01:26.036 ***** 2021-02-06T22:45:40.357 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-06T22:45:40.359 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.393 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.042) 0:01:26.078 ***** 2021-02-06T22:45:40.400 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-06T22:45:40.402 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.438 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.044) 0:01:26.123 ***** 2021-02-06T22:45:40.444 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-06T22:45:40.445 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:40.479 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.041) 0:01:26.164 ***** 2021-02-06T22:45:40.485 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-06T22:45:40.487 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.521 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.042) 0:01:26.206 ***** 2021-02-06T22:45:40.528 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-06T22:45:40.530 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.562 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.041) 0:01:26.247 ***** 2021-02-06T22:45:40.571 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-06T22:45:40.573 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.610 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.047) 0:01:26.295 ***** 2021-02-06T22:45:40.619 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-06T22:45:40.621 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:40.657 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.047) 0:01:26.342 ***** 2021-02-06T22:45:40.663 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-06T22:45:40.665 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.698 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.041) 0:01:26.383 ***** 2021-02-06T22:45:40.704 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-06T22:45:40.706 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.740 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.041) 0:01:26.425 ***** 2021-02-06T22:45:40.746 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-06T22:45:40.748 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.782 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.042) 0:01:26.467 ***** 2021-02-06T22:45:40.788 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-06T22:45:40.790 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.822 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.040) 0:01:26.507 ***** 2021-02-06T22:45:40.829 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-06T22:45:40.830 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.866 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.043) 0:01:26.551 ***** 2021-02-06T22:45:40.873 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-06T22:45:40.874 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.909 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.042) 0:01:26.594 ***** 2021-02-06T22:45:40.937 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-06T22:45:40.938 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:40.970 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:40 +0000 (0:00:00.061) 0:01:26.655 ***** 2021-02-06T22:45:40.997 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-06T22:45:40.999 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:41.042 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.072) 0:01:26.727 ***** 2021-02-06T22:45:41.070 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-06T22:45:41.071 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.104 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.061) 0:01:26.789 ***** 2021-02-06T22:45:41.142 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-06T22:45:41.144 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.177 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.072) 0:01:26.862 ***** 2021-02-06T22:45:41.204 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-06T22:45:41.205 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.239 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.062) 0:01:26.924 ***** 2021-02-06T22:45:41.265 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-06T22:45:41.267 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.299 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.059) 0:01:26.984 ***** 2021-02-06T22:45:41.326 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-06T22:45:41.328 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.360 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.061) 0:01:27.045 ***** 2021-02-06T22:45:41.387 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-06T22:45:41.389 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.421 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.060) 0:01:27.106 ***** 2021-02-06T22:45:41.447 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-06T22:45:41.481 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.060) 0:01:27.166 ***** 2021-02-06T22:45:41.508 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-06T22:45:41.509 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.542 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.060) 0:01:27.227 ***** 2021-02-06T22:45:41.548 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-06T22:45:41.550 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.464514", "end": "2021-02-06 22:45:41.500332", "rc": 0, "start": "2021-02-06 22:45:41.035818", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:45:41.584 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.042) 0:01:27.270 ***** 2021-02-06T22:45:41.591 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-06T22:45:41.593 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:41.627 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.042) 0:01:27.312 ***** 2021-02-06T22:45:41.868 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-06T22:45:41.870 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:45:41.902 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:41 +0000 (0:00:00.274) 0:01:27.587 ***** 2021-02-06T22:45:42.432 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-06T22:45:42.434 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-06T22:45:42.893 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-06T22:45:42.929 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:42 +0000 (0:00:01.027) 0:01:28.614 ***** 2021-02-06T22:45:43.416 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-06T22:45:43.418 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-06T22:45:43.876 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-06T22:45:43.911 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:43 +0000 (0:00:00.981) 0:01:29.596 ***** 2021-02-06T22:45:43.938 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-06T22:45:43.940 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:43.972 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:43 +0000 (0:00:00.060) 0:01:29.657 ***** 2021-02-06T22:45:43.998 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-06T22:45:44.000 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.032 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.060) 0:01:29.717 ***** 2021-02-06T22:45:44.058 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-06T22:45:44.060 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.093 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.060) 0:01:29.778 ***** 2021-02-06T22:45:44.119 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-06T22:45:44.121 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.153 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.059) 0:01:29.838 ***** 2021-02-06T22:45:44.191 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-06T22:45:44.192 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.202 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.213 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.247 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.094) 0:01:29.932 ***** 2021-02-06T22:45:44.284 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-06T22:45:44.286 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.319 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.072) 0:01:30.004 ***** 2021-02-06T22:45:44.346 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-06T22:45:44.348 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.381 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.061) 0:01:30.066 ***** 2021-02-06T22:45:44.408 INFO:teuthology.task.ansible.out: 2021-02-06T22:45:44.410 INFO:teuthology.task.ansible.out:TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.442 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.061) 0:01:30.127 ***** 2021-02-06T22:45:44.470 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-06T22:45:44.471 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.518 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.076) 0:01:30.203 ***** 2021-02-06T22:45:44.547 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-06T22:45:44.551 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:44.580 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:44 +0000 (0:00:00.062) 0:01:30.265 ***** 2021-02-06T22:45:45.515 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-06T22:45:45.516 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.744395", "end": "2021-02-06 22:45:45.500338", "rc": 0, "start": "2021-02-06 22:45:44.755943", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:45:45.548 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:45 +0000 (0:00:00.967) 0:01:31.233 ***** 2021-02-06T22:45:48.744 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-06T22:45:48.745 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-06T22:45:48.778 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:48 +0000 (0:00:03.229) 0:01:34.463 ***** 2021-02-06T22:45:48.805 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-06T22:45:48.807 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:48.838 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:48 +0000 (0:00:00.060) 0:01:34.523 ***** 2021-02-06T22:45:48.865 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-06T22:45:48.866 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:48.900 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:48 +0000 (0:00:00.061) 0:01:34.585 ***** 2021-02-06T22:45:48.928 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-06T22:45:48.930 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:48.964 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:48 +0000 (0:00:00.063) 0:01:34.649 ***** 2021-02-06T22:45:48.990 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-06T22:45:48.992 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:49.024 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:49 +0000 (0:00:00.060) 0:01:34.709 ***** 2021-02-06T22:45:49.490 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-06T22:45:49.492 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-06T22:45:49.524 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:49 +0000 (0:00:00.499) 0:01:35.209 ***** 2021-02-06T22:45:52.640 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-06T22:45:52.642 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: krb5-workstation", "Installed: krb5-workstation-1.18.2-5.el8.x86_64", "Installed: krb5-libs-1.18.2-5.el8.x86_64", "Installed: libkadm5-1.18.2-5.el8.x86_64", "Removed: krb5-workstation-1.17-18.el8.x86_64", "Removed: libkadm5-1.17-18.el8.x86_64", "Removed: krb5-libs-1.17-18.el8.x86_64"]} 2021-02-06T22:45:52.675 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:52 +0000 (0:00:03.150) 0:01:38.360 ***** 2021-02-06T22:45:52.701 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-06T22:45:52.703 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:52.734 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:52 +0000 (0:00:00.059) 0:01:38.419 ***** 2021-02-06T22:45:52.761 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-06T22:45:52.762 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:52.794 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:52 +0000 (0:00:00.060) 0:01:38.479 ***** 2021-02-06T22:45:52.821 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-06T22:45:52.823 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:52.858 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:52 +0000 (0:00:00.063) 0:01:38.543 ***** 2021-02-06T22:45:52.886 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-06T22:45:52.888 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:52.924 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:52 +0000 (0:00:00.065) 0:01:38.609 ***** 2021-02-06T22:45:52.974 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-06T22:45:52.976 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-06T22:45:53.012 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:53 +0000 (0:00:00.086) 0:01:38.696 ***** 2021-02-06T22:45:53.417 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-06T22:45:53.418 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-06T22:45:53.451 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:53 +0000 (0:00:00.439) 0:01:39.136 ***** 2021-02-06T22:45:53.499 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-06T22:45:53.500 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-06T22:45:53.941 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-06T22:45:54.368 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-02-06T22:45:54.406 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:54 +0000 (0:00:00.955) 0:01:40.091 ***** 2021-02-06T22:45:54.601 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-06T22:45:54.603 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:45:54.636 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:54 +0000 (0:00:00.229) 0:01:40.321 ***** 2021-02-06T22:45:55.145 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-06T22:45:55.146 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651554.660313-195601266928509/source", "state": "file", "uid": 0} 2021-02-06T22:45:55.564 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-06T22:45:55.985 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-06T22:45:56.022 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:56 +0000 (0:00:01.386) 0:01:41.707 ***** 2021-02-06T22:45:56.049 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-06T22:45:56.051 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:56.083 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:56 +0000 (0:00:00.060) 0:01:41.768 ***** 2021-02-06T22:45:56.120 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-06T22:45:56.122 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-06T22:45:56.165 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:56 +0000 (0:00:00.081) 0:01:41.850 ***** 2021-02-06T22:45:56.361 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-06T22:45:56.363 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-06T22:45:56.395 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:56 +0000 (0:00:00.230) 0:01:42.080 ***** 2021-02-06T22:45:56.432 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-06T22:45:56.434 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:56.444 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:56.455 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:56.466 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:56.500 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:56 +0000 (0:00:00.104) 0:01:42.185 ***** 2021-02-06T22:45:57.009 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-06T22:45:57.011 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: smartmontools", "Installed: smartmontools-1:7.1-1.el8.x86_64", "Removed: smartmontools-1:6.6-3.el8.x86_64"]} 2021-02-06T22:45:57.047 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:57 +0000 (0:00:00.546) 0:01:42.732 ***** 2021-02-06T22:45:57.514 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-06T22:45:57.516 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-06T22:45:57.558 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:57 +0000 (0:00:00.510) 0:01:43.243 ***** 2021-02-06T22:45:57.595 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-06T22:45:57.597 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:57.630 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:57 +0000 (0:00:00.071) 0:01:43.315 ***** 2021-02-06T22:45:57.710 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-06T22:45:57.711 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-06T22:45:58.076 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-06T22:45:58.078 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-06T22:45:58.112 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.482) 0:01:43.797 ***** 2021-02-06T22:45:58.159 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-06T22:45:58.161 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-06T22:45:58.559 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-06T22:45:58.561 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-06T22:45:58.594 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.482) 0:01:44.279 ***** 2021-02-06T22:45:58.600 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-06T22:45:58.602 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-02-06T22:45:58.652 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.057) 0:01:44.337 ***** 2021-02-06T22:45:58.661 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-06T22:45:58.663 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-06T22:45:58.701 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.048) 0:01:44.386 ***** 2021-02-06T22:45:58.854 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-06T22:45:58.856 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:45:58.890 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.188) 0:01:44.575 ***** 2021-02-06T22:45:58.909 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-06T22:45:58.911 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:45:58.948 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:58 +0000 (0:00:00.058) 0:01:44.633 ***** 2021-02-06T22:45:59.184 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-06T22:45:59.185 INFO:teuthology.task.ansible.out:fatal: [smithi106.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-06T22:45:59.218 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:59 +0000 (0:00:00.269) 0:01:44.903 ***** 2021-02-06T22:45:59.245 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-06T22:45:59.247 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:45:59.279 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:59 +0000 (0:00:00.060) 0:01:44.964 ***** 2021-02-06T22:45:59.421 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-06T22:45:59.423 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651558.9145308-61496789518762/source", "state": "file", "uid": 0} 2021-02-06T22:45:59.726 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-06T22:45:59.728 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-06T22:45:59.760 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:45:59 +0000 (0:00:00.480) 0:01:45.445 ***** 2021-02-06T22:45:59.850 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-06T22:45:59.851 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-06T22:46:00.280 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-06T22:46:00.315 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.555) 0:01:46.000 ***** 2021-02-06T22:46:00.342 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-06T22:46:00.344 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:46:00.381 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.065) 0:01:46.066 ***** 2021-02-06T22:46:00.421 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-06T22:46:00.423 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-06T22:46:00.457 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.075) 0:01:46.142 ***** 2021-02-06T22:46:00.496 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-06T22:46:00.497 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-06 22:44:01 UTC", "ActiveEnterTimestampMonotonic": "13399586", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target sysinit.target tmp.mount time-sync.target nss-lookup.target network.target systemd-tmpfiles-setup.service -.mount system.slice var-run.mount systemd-journald.socket basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-06 22:44:01 UTC", "AssertTimestampMonotonic": "13398367", "Before": "xdm.service plymouth-quit.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-06 22:44:01 UTC", "ConditionTimestampMonotonic": "13398367", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "Co 2021-02-06T22:46:00.499 INFO:teuthology.task.ansible.out:ntrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "941", "ExecMainStartTimestamp": "Sat 2021-02-06 22:44:01 UTC", "ExecMainStartTimestampMonotonic": "13399546", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-06 22:44:01 UTC", "InactiveExitTimestampMonotonic": "13399586", "InvocationID": "5e3cdb2d9ad74ecb97e85305ebb21159", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-06T22:46:00.501 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "941", "MemoryAccounting": "yes", "MemoryCurrent": "1409024", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", 2021-02-06T22:46:00.503 INFO:teuthology.task.ansible.out:"Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-06 22:44:01 UTC", "StateChangeTimestampMonotonic": "13399586", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-06 22:44:01 UTC", "WatchdogTimestampMonotonic": "13399585", "WatchdogUSec": "0"}} 2021-02-06T22:46:00.534 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.077) 0:01:46.219 ***** 2021-02-06T22:46:00.660 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi051.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-06T22:46:00.721 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.159) 0:01:46.378 ***** 2021-02-06T22:46:00.731 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-06T22:46:00.733 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001783", "end": "2021-02-06 22:46:00.708579", "rc": 0, "start": "2021-02-06 22:46:00.706796", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} TASK [common : Install nrpe without epel] ************************************** skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:46:00.767 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.074) 0:01:46.452 ***** 2021-02-06T22:46:00.774 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:46:00.775 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-06T22:46:00.812 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:00 +0000 (0:00:00.044) 0:01:46.497 ***** 2021-02-06T22:46:01.895 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-06T22:46:01.897 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-06T22:46:01.930 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:01 +0000 (0:00:01.117) 0:01:47.615 ***** 2021-02-06T22:46:01.956 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-06T22:46:01.958 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:46:02.008 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:02 +0000 (0:00:00.077) 0:01:47.692 ***** 2021-02-06T22:46:02.493 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-06T22:46:02.495 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-06T22:46:02.529 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:02 +0000 (0:00:00.521) 0:01:48.214 ***** 2021-02-06T22:46:03.009 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-06T22:46:03.011 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-06T22:46:03.067 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.538) 0:01:48.752 ***** 2021-02-06T22:46:03.107 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-06T22:46:03.109 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-06T22:46:03.142 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.074) 0:01:48.827 ***** 2021-02-06T22:46:03.362 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-06T22:46:03.364 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:46:03.396 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.254) 0:01:49.081 ***** 2021-02-06T22:46:03.642 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-06T22:46:03.643 INFO:teuthology.task.ansible.out:fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-06T22:46:03.678 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.281) 0:01:49.363 ***** 2021-02-06T22:46:03.717 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-06T22:46:03.718 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:46:03.753 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.074) 0:01:49.438 ***** 2021-02-06T22:46:03.759 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-06T22:46:03.761 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Installed: libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-06T22:46:03.797 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:03 +0000 (0:00:00.044) 0:01:49.482 ***** 2021-02-06T22:46:04.235 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-06T22:46:04.237 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-06T22:46:04.273 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:04 +0000 (0:00:00.475) 0:01:49.958 ***** 2021-02-06T22:46:04.593 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-06T22:46:04.594 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-06 22:43:55 UTC", "ActiveEnterTimestampMonotonic": "16432586", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target time-sync.target basic.target tmp.mount systemd-tmpfiles-setup.service sysinit.target -.mount var-run.mount systemd-journald.socket nss-lookup.target local-fs.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-06 22:43:55 UTC", "AssertTimestampMonotonic": "16431748", "Before": "getty@tty1.service xdm.service shutdown.target multi-user.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-06 22:43:55 UTC", "ConditionTimestampMonotonic": "16431747", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "Co 2021-02-06T22:46:04.596 INFO:teuthology.task.ansible.out:ntrolGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "938", "ExecMainStartTimestamp": "Sat 2021-02-06 22:43:55 UTC", "ExecMainStartTimestampMonotonic": "16432561", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-06 22:43:55 UTC", "InactiveExitTimestampMonotonic": "16432586", "InvocationID": "b421697da4a840aa8320cd9dd612bb5a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", " 2021-02-06T22:46:04.598 INFO:teuthology.task.ansible.out:LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127286", "LimitNPROCSoft": "127286", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127286", "LimitSIGPENDINGSoft": "127286", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "938", "MemoryAccounting": "yes", "MemoryCurrent": "1740800", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", 2021-02-06T22:46:04.599 INFO:teuthology.task.ansible.out:"Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-06 22:43:55 UTC", "StateChangeTimestampMonotonic": "16432586", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203657", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-06 22:43:55 UTC", "WatchdogTimestampMonotonic": "16432585", "WatchdogUSec": "0"}} 2021-02-06T22:46:04.629 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:04 +0000 (0:00:00.356) 0:01:50.314 ***** 2021-02-06T22:46:04.826 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-06T22:46:04.828 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001831", "end": "2021-02-06 22:46:04.805799", "rc": 0, "start": "2021-02-06 22:46:04.803968", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-06T22:46:04.859 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:04 +0000 (0:00:00.229) 0:01:50.544 ***** 2021-02-06T22:46:07.668 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-06T22:46:07.670 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils", "Installed: python3-libsemanage-2.9-3.el8.x86_64", "Installed: libsemanage-2.9-3.el8.x86_64", "Removed: python3-libsemanage-2.9-2.el8.x86_64", "Removed: libsemanage-2.9-2.el8.x86_64"]} 2021-02-06T22:46:07.702 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:07 +0000 (0:00:02.842) 0:01:53.387 ***** 2021-02-06T22:46:42.392 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-06T22:46:42.394 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-06T22:46:42.431 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:42 +0000 (0:00:34.729) 0:02:28.116 ***** 2021-02-06T22:46:43.132 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-06T22:46:43.134 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-06T22:46:43.167 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:43 +0000 (0:00:00.735) 0:02:28.852 ***** 2021-02-06T22:46:48.260 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-06T22:46:48.261 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-41.el8_2.8.noarch", "Removed: selinux-policy-targeted-3.14.3-41.el8_2.8.noarch"]} 2021-02-06T22:46:48.295 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:48 +0000 (0:00:05.127) 0:02:33.980 ***** 2021-02-06T22:46:48.753 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-06T22:46:48.755 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-06T22:46:48.786 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:46:48 +0000 (0:00:00.491) 0:02:34.471 ***** 2021-02-06T22:47:00.026 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-06T22:47:00.028 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.647926", "end": "2021-02-06 22:47:00.000209", "failed_when_result": false, "rc": 0, "start": "2021-02-06 22:46:43.352283", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-06T22:47:00.064 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:00 +0000 (0:00:11.278) 0:02:45.749 ***** 2021-02-06T22:47:00.519 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-06T22:47:00.521 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-06T22:47:00.554 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:00 +0000 (0:00:00.489) 0:02:46.239 ***** 2021-02-06T22:47:00.761 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-06T22:47:00.763 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012543", "end": "2021-02-06 22:47:00.745915", "rc": 0, "start": "2021-02-06 22:47:00.733372", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:00.796 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:00 +0000 (0:00:00.242) 0:02:46.481 ***** 2021-02-06T22:47:00.994 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-06T22:47:00.995 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011674", "end": "2021-02-06 22:47:00.977019", "rc": 0, "start": "2021-02-06 22:47:00.965345", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:01.030 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:01 +0000 (0:00:00.233) 0:02:46.715 ***** 2021-02-06T22:47:06.403 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-06T22:47:06.405 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:17.421456", "end": "2021-02-06 22:47:06.384353", "failed_when_result": false, "rc": 0, "start": "2021-02-06 22:46:48.962897", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-06T22:47:06.438 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:06 +0000 (0:00:05.408) 0:02:52.123 ***** 2021-02-06T22:47:06.916 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-06T22:47:06.918 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-06T22:47:06.951 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:06 +0000 (0:00:00.513) 0:02:52.636 ***** 2021-02-06T22:47:07.166 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-06T22:47:07.168 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015288", "end": "2021-02-06 22:47:07.145080", "rc": 0, "start": "2021-02-06 22:47:07.129792", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:07.204 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:07 +0000 (0:00:00.252) 0:02:52.889 ***** 2021-02-06T22:47:07.419 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-06T22:47:07.421 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014081", "end": "2021-02-06 22:47:07.396305", "rc": 0, "start": "2021-02-06 22:47:07.382224", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:07.453 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:07 +0000 (0:00:00.248) 0:02:53.138 ***** 2021-02-06T22:47:17.760 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-06T22:47:17.762 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.546773", "end": "2021-02-06 22:47:17.743230", "rc": 0, "start": "2021-02-06 22:47:01.196457", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:17.795 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:17 +0000 (0:00:10.341) 0:03:03.480 ***** 2021-02-06T22:47:17.989 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-06T22:47:17.991 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-06T22:47:18.023 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.227) 0:03:03.708 ***** 2021-02-06T22:47:18.049 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-06T22:47:18.051 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-06T22:47:18.084 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.061) 0:03:03.769 ***** 2021-02-06T22:47:18.121 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-06T22:47:18.123 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-06T22:47:18.155 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.071) 0:03:03.841 ***** 2021-02-06T22:47:18.192 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-06T22:47:18.194 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-06T22:47:18.227 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.071) 0:03:03.912 ***** 2021-02-06T22:47:18.267 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-06T22:47:18.269 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-06T22:47:18.301 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.074) 0:03:03.986 ***** 2021-02-06T22:47:18.484 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-06T22:47:18.485 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-06T22:47:18.517 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.215) 0:03:04.202 ***** 2021-02-06T22:47:18.710 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-06T22:47:18.712 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-02-06T22:47:18.744 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.227) 0:03:04.429 ***** 2021-02-06T22:47:18.771 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-06T22:47:18.773 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:18.805 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.060) 0:03:04.490 ***** 2021-02-06T22:47:18.831 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-06T22:47:18.833 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:18.864 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:18 +0000 (0:00:00.059) 0:03:04.549 ***** 2021-02-06T22:47:19.067 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-06T22:47:19.069 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-06T22:47:19.100 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:19 +0000 (0:00:00.235) 0:03:04.785 ***** 2021-02-06T22:47:19.731 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-06T22:47:19.732 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-06T22:47:19.764 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:19 +0000 (0:00:00.664) 0:03:05.449 ***** 2021-02-06T22:47:19.801 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-06T22:47:19.803 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi106"}, "changed": false} 2021-02-06T22:47:19.834 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:19 +0000 (0:00:00.070) 0:03:05.519 ***** 2021-02-06T22:47:20.827 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-06T22:47:20.829 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi106.front.sepia.ceph.com", "ansible_hostname": "smithi106", "ansible_nodename": "smithi106"}, "changed": true, "name": "smithi106"} 2021-02-06T22:47:20.866 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:20 +0000 (0:00:01.031) 0:03:06.551 ***** 2021-02-06T22:47:21.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-06T22:47:21.310 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-06T22:47:21.343 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:21 +0000 (0:00:00.476) 0:03:07.028 ***** 2021-02-06T22:47:21.806 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-06T22:47:21.808 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-06T22:47:21.841 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:21 +0000 (0:00:00.498) 0:03:07.526 ***** 2021-02-06T22:47:22.483 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-06T22:47:22.484 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-06T22:47:22.517 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:22 +0000 (0:00:00.674) 0:03:08.201 ***** 2021-02-06T22:47:22.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-06T22:47:22.981 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-06T22:47:23.021 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:23 +0000 (0:00:00.505) 0:03:08.706 ***** 2021-02-06T22:47:23.216 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-06T22:47:23.218 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-06T22:47:23.250 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:23 +0000 (0:00:00.228) 0:03:08.935 ***** 2021-02-06T22:47:23.445 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-06T22:47:23.446 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-06T22:47:23.477 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:23 +0000 (0:00:00.227) 0:03:09.162 ***** 2021-02-06T22:47:23.693 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-06T22:47:23.695 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-06T22:47:23.729 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:23 +0000 (0:00:00.251) 0:03:09.414 ***** 2021-02-06T22:47:24.181 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-06T22:47:24.183 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-06T22:47:24.215 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:24 +0000 (0:00:00.485) 0:03:09.900 ***** 2021-02-06T22:47:24.676 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-06T22:47:24.678 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-06T22:47:24.727 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:24 +0000 (0:00:00.512) 0:03:10.412 ***** 2021-02-06T22:47:25.637 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-06T22:47:25.638 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:17.984913", "end": "2021-02-06 22:47:25.614325", "rc": 0, "start": "2021-02-06 22:47:07.629412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:25.671 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:25 +0000 (0:00:00.944) 0:03:11.356 ***** 2021-02-06T22:47:25.875 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-06T22:47:25.877 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-06T22:47:25.909 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:25 +0000 (0:00:00.238) 0:03:11.594 ***** 2021-02-06T22:47:25.939 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-06T22:47:25.940 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-06T22:47:25.972 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:25 +0000 (0:00:00.062) 0:03:11.657 ***** 2021-02-06T22:47:26.126 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-06T22:47:26.128 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-06T22:47:26.275 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.302) 0:03:11.960 ***** 2021-02-06T22:47:26.312 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-06T22:47:26.314 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-02-06T22:47:26.348 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.072) 0:03:12.033 ***** 2021-02-06T22:47:26.385 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-06T22:47:26.387 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-06T22:47:26.418 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.070) 0:03:12.103 ***** 2021-02-06T22:47:26.622 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-06T22:47:26.624 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-06T22:47:26.654 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.235) 0:03:12.339 ***** 2021-02-06T22:47:26.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-06T22:47:26.850 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-02-06T22:47:26.882 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.227) 0:03:12.567 ***** 2021-02-06T22:47:26.909 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-06T22:47:26.911 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:26.942 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.060) 0:03:12.627 ***** 2021-02-06T22:47:26.969 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-06T22:47:26.971 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:27.003 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:26 +0000 (0:00:00.060) 0:03:12.688 ***** 2021-02-06T22:47:27.009 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-06T22:47:27.011 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.075146", "end": "2021-02-06 22:47:26.968361", "rc": 0, "start": "2021-02-06 22:47:24.893215", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:27.049 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:27 +0000 (0:00:00.046) 0:03:12.734 ***** 2021-02-06T22:47:27.222 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-06T22:47:27.224 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-02-06T22:47:27.259 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:27 +0000 (0:00:00.209) 0:03:12.944 ***** 2021-02-06T22:47:27.530 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-06T22:47:27.532 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-06T22:47:27.802 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-06T22:47:27.804 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-06T22:47:27.838 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:27 +0000 (0:00:00.578) 0:03:13.523 ***** 2021-02-06T22:47:27.867 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi051"}, "changed": false} 2021-02-06T22:47:27.902 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:27 +0000 (0:00:00.064) 0:03:13.587 ***** 2021-02-06T22:47:27.955 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-06T22:47:27.957 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-06T22:47:28.396 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-06T22:47:28.431 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:28 +0000 (0:00:00.529) 0:03:14.116 ***** 2021-02-06T22:47:28.500 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-06T22:47:28.502 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi051.front.sepia.ceph.com", "ansible_hostname": "smithi051", "ansible_nodename": "smithi051"}, "changed": true, "name": "smithi051"} 2021-02-06T22:47:28.538 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:28 +0000 (0:00:00.107) 0:03:14.223 ***** 2021-02-06T22:47:28.902 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-06T22:47:28.903 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-06T22:47:28.938 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:28 +0000 (0:00:00.400) 0:03:14.623 ***** 2021-02-06T22:47:29.007 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-06T22:47:29.009 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-06T22:47:29.043 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:29 +0000 (0:00:00.104) 0:03:14.728 ***** 2021-02-06T22:47:29.405 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-06T22:47:29.407 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-06T22:47:29.511 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-06T22:47:29.513 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-06T22:47:29.545 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:29 +0000 (0:00:00.501) 0:03:15.230 ***** 2021-02-06T22:47:29.842 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-06T22:47:29.844 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-06T22:47:30.210 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-06T22:47:30.212 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-06T22:47:30.247 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.702) 0:03:15.932 ***** 2021-02-06T22:47:30.286 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-06T22:47:30.288 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-06T22:47:30.325 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.077) 0:03:16.010 ***** 2021-02-06T22:47:30.351 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-06T22:47:30.385 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.059) 0:03:16.070 ***** 2021-02-06T22:47:30.411 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-06T22:47:30.413 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:30.447 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.062) 0:03:16.132 ***** 2021-02-06T22:47:30.484 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-06T22:47:30.486 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-06T22:47:30.530 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.082) 0:03:16.215 ***** 2021-02-06T22:47:30.555 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-06T22:47:30.557 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:30.589 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.059) 0:03:16.274 ***** 2021-02-06T22:47:30.626 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:47:30.628 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-06T22:47:30.660 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.071) 0:03:16.345 ***** 2021-02-06T22:47:30.697 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-06T22:47:30.699 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:30.731 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.070) 0:03:16.416 ***** 2021-02-06T22:47:30.737 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-06T22:47:30.737 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-06T22:47:30.773 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.042) 0:03:16.458 ***** 2021-02-06T22:47:30.779 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-06T22:47:30.781 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:30.815 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:30 +0000 (0:00:00.041) 0:03:16.500 ***** 2021-02-06T22:47:30.979 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-06T22:47:30.981 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-06T22:47:31.015 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:31 +0000 (0:00:00.200) 0:03:16.700 ***** 2021-02-06T22:47:31.023 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-06T22:47:31.024 INFO:teuthology.task.ansible.out:fatal: [smithi106.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007264", "end": "2021-02-06 22:47:31.001225", "msg": "non-zero return code", "rc": 1, "start": "2021-02-06 22:47:30.993961", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-06T22:47:31.058 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:31 +0000 (0:00:00.042) 0:03:16.743 ***** 2021-02-06T22:47:31.084 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-06T22:47:31.086 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:31.118 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:31 +0000 (0:00:00.059) 0:03:16.803 ***** 2021-02-06T22:47:31.218 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-06T22:47:31.219 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-06T22:47:31.252 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:31 +0000 (0:00:00.133) 0:03:16.936 ***** 2021-02-06T22:47:31.477 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-06T22:47:31.479 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-06T22:47:31.517 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:31 +0000 (0:00:00.265) 0:03:17.202 ***** 2021-02-06T22:47:32.001 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-06T22:47:32.003 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-06T22:47:32.042 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:32 +0000 (0:00:00.524) 0:03:17.727 ***** 2021-02-06T22:47:32.518 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-06T22:47:32.520 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-06T22:47:32.552 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:32 +0000 (0:00:00.510) 0:03:18.237 ***** 2021-02-06T22:47:33.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-06T22:47:33.432 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-06T22:47:33.466 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:33 +0000 (0:00:00.913) 0:03:19.151 ***** 2021-02-06T22:47:34.900 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-06T22:47:34.902 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.150181", "end": "2021-02-06 22:47:34.877578", "rc": 0, "start": "2021-02-06 22:47:32.727397", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:47:34.936 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:34 +0000 (0:00:01.469) 0:03:20.621 ***** 2021-02-06T22:47:35.431 INFO:teuthology.task.ansible.out: 2021-02-06T22:47:35.432 INFO:teuthology.task.ansible.out:TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-06T22:47:35.433 INFO:teuthology.task.ansible.out: 2021-02-06T22:47:35.434 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-02-06T22:47:35.537 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-06T22:47:35.539 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-06T22:47:35.574 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:35 +0000 (0:00:00.637) 0:03:21.259 ***** 2021-02-06T22:47:35.882 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-06T22:47:35.884 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-02-06T22:47:36.329 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-02-06T22:47:36.366 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:36 +0000 (0:00:00.792) 0:03:22.051 ***** 2021-02-06T22:47:36.851 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-06T22:47:36.852 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-06T22:47:36.886 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:36 +0000 (0:00:00.520) 0:03:22.571 ***** 2021-02-06T22:47:37.381 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-06T22:47:37.383 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-02-06T22:47:37.830 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-02-06T22:47:38.278 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-02-06T22:47:38.316 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:01.429) 0:03:24.001 ***** 2021-02-06T22:47:38.343 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-06T22:47:38.377 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.060) 0:03:24.062 ***** 2021-02-06T22:47:38.404 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:38.439 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.062) 0:03:24.124 ***** 2021-02-06T22:47:38.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-06T22:47:38.478 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-06T22:47:38.512 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.073) 0:03:24.197 ***** 2021-02-06T22:47:38.551 INFO:teuthology.task.ansible.out: 2021-02-06T22:47:38.552 INFO:teuthology.task.ansible.out:TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:38.586 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.073) 0:03:24.271 ***** 2021-02-06T22:47:38.623 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:47:38.625 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-02-06T22:47:38.657 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.070) 0:03:24.342 ***** 2021-02-06T22:47:38.694 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-06T22:47:38.695 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:38.728 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.071) 0:03:24.413 ***** 2021-02-06T22:47:38.765 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-06T22:47:38.767 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:38.799 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:38 +0000 (0:00:00.071) 0:03:24.484 ***** 2021-02-06T22:47:39.014 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-06T22:47:39.015 INFO:teuthology.task.ansible.out:fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007582", "end": "2021-02-06 22:47:38.991402", "msg": "non-zero return code", "rc": 1, "start": "2021-02-06 22:47:38.983820", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-06T22:47:39.050 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:39 +0000 (0:00:00.250) 0:03:24.735 ***** 2021-02-06T22:47:39.088 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-06T22:47:39.089 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:47:39.137 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:39 +0000 (0:00:00.086) 0:03:24.822 ***** 2021-02-06T22:47:41.587 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-06T22:47:41.588 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64"]} 2021-02-06T22:47:41.621 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:41 +0000 (0:00:02.483) 0:03:27.306 ***** 2021-02-06T22:47:43.824 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-06T22:47:43.826 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64"]} 2021-02-06T22:47:43.858 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:47:43 +0000 (0:00:02.237) 0:03:29.543 ***** 2021-02-06T22:48:18.416 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:18.417 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.no 2021-02-06T22:48:18.419 INFO:teuthology.task.ansible.out:arch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: podman-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-catatonit-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-docker-2.0.5-5.module_el8.3.0+512+b3b58dca.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm- 2021-02-06T22:48:18.420 INFO:teuthology.task.ansible.out:common-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Removed: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plu 2021-02-06T22:48:18.422 INFO:teuthology.task.ansible.out:gins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-06T22:48:18.458 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:18 +0000 (0:00:34.599) 0:04:04.143 ***** 2021-02-06T22:48:18.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-06T22:48:18.486 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:18.518 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:18 +0000 (0:00:00.059) 0:04:04.203 ***** 2021-02-06T22:48:19.616 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-06T22:48:19.618 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-06T22:48:19.650 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:19 +0000 (0:00:01.132) 0:04:05.335 ***** 2021-02-06T22:48:19.677 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-06T22:48:19.679 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:19.711 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:19 +0000 (0:00:00.061) 0:04:05.396 ***** 2021-02-06T22:48:20.019 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-06T22:48:20.020 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket polkit.service system.slice dbus.service sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ip6tables.service ebtables.service ipset.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNode 2021-02-06T22:48:20.021 INFO:teuthology.task.ansible.out:s": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "L 2021-02-06T22:48:20.023 INFO:teuthology.task.ansible.out:imitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWe 2021-02-06T22:48:20.024 INFO:teuthology.task.ansible.out:ight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-06T22:48:20.055 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:20 +0000 (0:00:00.343) 0:04:05.740 ***** 2021-02-06T22:48:20.341 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-06T22:48:20.343 INFO:teuthology.task.ansible.out:fatal: [smithi106.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-06T22:48:20.378 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:20 +0000 (0:00:00.322) 0:04:06.063 ***** 2021-02-06T22:48:21.064 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-06T22:48:21.066 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-06T22:48:21.103 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.724) 0:04:06.788 ***** 2021-02-06T22:48:21.131 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-06T22:48:21.133 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.168 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.065) 0:04:06.853 ***** 2021-02-06T22:48:21.195 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-06T22:48:21.196 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.230 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.062) 0:04:06.915 ***** 2021-02-06T22:48:21.257 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-06T22:48:21.258 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.293 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.062) 0:04:06.978 ***** 2021-02-06T22:48:21.330 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-06T22:48:21.332 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.370 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.077) 0:04:07.055 ***** 2021-02-06T22:48:21.397 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-06T22:48:21.399 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.430 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.060) 0:04:07.115 ***** 2021-02-06T22:48:21.457 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.490 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.060) 0:04:07.175 ***** 2021-02-06T22:48:21.517 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-06T22:48:21.552 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.061) 0:04:07.237 ***** 2021-02-06T22:48:21.578 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-06T22:48:21.580 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.613 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.061) 0:04:07.298 ***** 2021-02-06T22:48:21.639 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-06T22:48:21.641 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.673 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.059) 0:04:07.358 ***** 2021-02-06T22:48:21.710 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-06T22:48:21.711 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.744 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.071) 0:04:07.429 ***** 2021-02-06T22:48:21.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-06T22:48:21.773 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.804 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.059) 0:04:07.489 ***** 2021-02-06T22:48:21.831 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-06T22:48:21.864 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.059) 0:04:07.549 ***** 2021-02-06T22:48:21.891 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-06T22:48:21.892 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.927 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.062) 0:04:07.612 ***** 2021-02-06T22:48:21.953 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-06T22:48:21.955 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:21.991 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:21 +0000 (0:00:00.063) 0:04:07.676 ***** 2021-02-06T22:48:22.018 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-06T22:48:22.020 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.056 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.065) 0:04:07.741 ***** 2021-02-06T22:48:22.082 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-06T22:48:22.084 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.118 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.062) 0:04:07.803 ***** 2021-02-06T22:48:22.145 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-06T22:48:22.147 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.182 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.063) 0:04:07.867 ***** 2021-02-06T22:48:22.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:22.210 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.242 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:07.927 ***** 2021-02-06T22:48:22.269 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-06T22:48:22.271 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.303 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:07.988 ***** 2021-02-06T22:48:22.329 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-06T22:48:22.331 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.363 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.059) 0:04:08.048 ***** 2021-02-06T22:48:22.389 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-06T22:48:22.391 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.423 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.059) 0:04:08.108 ***** 2021-02-06T22:48:22.450 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-06T22:48:22.452 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.483 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:08.168 ***** 2021-02-06T22:48:22.510 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-06T22:48:22.512 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.544 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.061) 0:04:08.229 ***** 2021-02-06T22:48:22.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.604 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:08.289 ***** 2021-02-06T22:48:22.631 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-06T22:48:22.633 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.664 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:08.349 ***** 2021-02-06T22:48:22.691 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-06T22:48:22.693 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.725 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.060) 0:04:08.410 ***** 2021-02-06T22:48:22.751 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.784 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.059) 0:04:08.469 ***** 2021-02-06T22:48:22.811 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-06T22:48:22.812 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.844 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.059) 0:04:08.529 ***** 2021-02-06T22:48:22.871 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-06T22:48:22.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.904 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.059) 0:04:08.589 ***** 2021-02-06T22:48:22.941 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-06T22:48:22.943 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:22.977 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:22 +0000 (0:00:00.072) 0:04:08.662 ***** 2021-02-06T22:48:23.007 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-06T22:48:23.009 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.041 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.063) 0:04:08.726 ***** 2021-02-06T22:48:23.067 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-06T22:48:23.069 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.101 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.060) 0:04:08.786 ***** 2021-02-06T22:48:23.128 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-06T22:48:23.130 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.161 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.060) 0:04:08.847 ***** 2021-02-06T22:48:23.189 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-06T22:48:23.191 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.223 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.061) 0:04:08.908 ***** 2021-02-06T22:48:23.250 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:23.252 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.285 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.061) 0:04:08.970 ***** 2021-02-06T22:48:23.312 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-06T22:48:23.314 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.348 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.063) 0:04:09.033 ***** 2021-02-06T22:48:23.375 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:23.376 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.408 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.060) 0:04:09.093 ***** 2021-02-06T22:48:23.435 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.478 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.069) 0:04:09.163 ***** 2021-02-06T22:48:23.511 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-06T22:48:23.512 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:23.546 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.067) 0:04:09.231 ***** 2021-02-06T22:48:23.763 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:23.765 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-06T22:48:23.818 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:23 +0000 (0:00:00.271) 0:04:09.503 ***** 2021-02-06T22:48:24.037 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-06T22:48:24.039 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:48:24.077 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.259) 0:04:09.762 ***** 2021-02-06T22:48:24.272 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-06T22:48:24.274 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-06T22:48:24.306 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.228) 0:04:09.991 ***** 2021-02-06T22:48:24.333 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-06T22:48:24.335 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.371 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.064) 0:04:10.056 ***** 2021-02-06T22:48:24.399 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-06T22:48:24.401 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.433 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.062) 0:04:10.119 ***** 2021-02-06T22:48:24.460 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-06T22:48:24.462 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.494 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.060) 0:04:10.179 ***** 2021-02-06T22:48:24.521 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:24.524 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.562 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.067) 0:04:10.247 ***** 2021-02-06T22:48:24.591 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-06T22:48:24.592 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.626 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.064) 0:04:10.311 ***** 2021-02-06T22:48:24.653 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-06T22:48:24.655 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.690 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.063) 0:04:10.375 ***** 2021-02-06T22:48:24.717 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:24.719 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.751 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.061) 0:04:10.436 ***** 2021-02-06T22:48:24.778 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-06T22:48:24.780 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.812 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.061) 0:04:10.497 ***** 2021-02-06T22:48:24.840 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.876 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.063) 0:04:10.561 ***** 2021-02-06T22:48:24.904 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-06T22:48:24.906 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:24.942 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:24 +0000 (0:00:00.065) 0:04:10.627 ***** 2021-02-06T22:48:24.969 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-06T22:48:24.971 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.017 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.075) 0:04:10.702 ***** 2021-02-06T22:48:25.044 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-06T22:48:25.045 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.078 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.060) 0:04:10.763 ***** 2021-02-06T22:48:25.105 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-06T22:48:25.107 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.140 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.062) 0:04:10.825 ***** 2021-02-06T22:48:25.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-06T22:48:25.169 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.207 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.066) 0:04:10.892 ***** 2021-02-06T22:48:25.247 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-06T22:48:25.249 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.284 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.076) 0:04:10.969 ***** 2021-02-06T22:48:25.310 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-06T22:48:25.312 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.345 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.061) 0:04:11.030 ***** 2021-02-06T22:48:25.372 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-06T22:48:25.373 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.405 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.060) 0:04:11.090 ***** 2021-02-06T22:48:25.433 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-06T22:48:25.435 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.466 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.060) 0:04:11.151 ***** 2021-02-06T22:48:25.494 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-06T22:48:25.496 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.528 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.061) 0:04:11.213 ***** 2021-02-06T22:48:25.554 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-06T22:48:25.556 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.588 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.060) 0:04:11.273 ***** 2021-02-06T22:48:25.625 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-06T22:48:25.627 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.661 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.073) 0:04:11.346 ***** 2021-02-06T22:48:25.691 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-06T22:48:25.693 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.728 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.066) 0:04:11.413 ***** 2021-02-06T22:48:25.757 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:25.759 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-06T22:48:25.790 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.062) 0:04:11.475 ***** 2021-02-06T22:48:25.838 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-06T22:48:25.840 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.850 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-06T22:48:25.861 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.883 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.894 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.905 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:25.948 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:25 +0000 (0:00:00.157) 0:04:11.633 ***** 2021-02-06T22:48:26.154 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-06T22:48:26.156 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003008", "end": "2021-02-06 22:48:26.132943", "rc": 0, "start": "2021-02-06 22:48:26.129935", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology-lock"]} 2021-02-06T22:48:26.193 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:26 +0000 (0:00:00.244) 0:04:11.878 ***** 2021-02-06T22:48:26.220 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-06T22:48:26.222 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:26.262 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:26 +0000 (0:00:00.068) 0:04:11.947 ***** 2021-02-06T22:48:26.299 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-06T22:48:26.301 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:26.336 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:26 +0000 (0:00:00.074) 0:04:12.021 ***** 2021-02-06T22:48:26.363 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-06T22:48:26.365 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:26.397 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:26 +0000 (0:00:00.060) 0:04:12.082 ***** 2021-02-06T22:48:26.424 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-06T22:48:26.426 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:26.457 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:26 +0000 (0:00:00.060) 0:04:12.143 ***** 2021-02-06T22:48:27.962 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:27.964 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: util-linux-2.32.1-24.el8.x86_64", "Installed: util-linux-user-2.32.1-24.el8.x86_64", "Installed: python3-libdnf-0.48.0-5.el8.x86_64", "Installed: libdnf-0.48.0-5.el8.x86_64", "Installed: python3-librepo-1.12.0-2.el8.x86_64", "Installed: boost-chrono-1.66.0-10.el8.x86_64", "Installed: xfsprogs-5.0.0-4.el8.x86_64", "Installed: libfdisk-2.32.1-24.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: gdb-8.2-12.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: nfs-utils-1:2.3.3-35.el8.x86_64", "Installed: gcc-8.3.1-5.1.el8.x86_64", "Installed: gdb-headless-8.2-12.el8.x86_64", "Installed: libuuid-2.32.1-24.el8.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: gcc-gdb-plugin-8.3.1-5.1.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: python3-virtualenv-15.1.0-19.module_el8.3.0+562+e162826a.noarch", "Installed: libgcc-8.3.1-5.1.el8.x86_64", "Installed: libgcrypt-1.8.5-4.el8.x86_64", "Installed: yum-utils-4.0.17-5.el8.no 2021-02-06T22:48:27.966 INFO:teuthology.task.ansible.out:arch", "Installed: libgomp-8.3.1-5.1.el8.x86_64", "Installed: yum-4.2.23-4.el8.noarch", "Installed: perl-Git-2.27.0-1.el8.noarch", "Installed: boost-system-1.66.0-10.el8.x86_64", "Installed: boost-thread-1.66.0-10.el8.x86_64", "Installed: librepo-1.12.0-2.el8.x86_64", "Installed: podman-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-catatonit-2.0.5-5.module_el8.3.0+512+b3b58dca.x86_64", "Installed: podman-docker-2.0.5-5.module_el8.3.0+512+b3b58dca.noarch", "Installed: dnf-4.2.23-4.el8.noarch", "Installed: dnf-data-4.2.23-4.el8.noarch", "Installed: dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: python3-nose-1.3.7-30.module_el8.3.0+562+e162826a.noarch", "Installed: libsmartcols-2.32.1-24.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: lsof-4.93.2-1.el8.x86_64", "Installed: valgrind-1:3.16.0-2.el8.x86_64", "Installed: libblkid-2.32.1-24.el8.x86_64", "Installed: git-2.27.0-1.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: git-core-2.27.0-1.el8.x86_64", "Installed: git-core-doc-2.27.0-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module_el8.3.0+613+9ec9f184.1.x86_64", "Installed: python3-hawkey-0.48.0-5.el8.x86_64", "Installed: cpp-8.3.1-5.1.el8.x86_64", "Installed: libmodulemd-2.9.4-2.el8.x86_64", "Installed: libmount-2.32.1-24.el8.x86_64", "Installed: python3-dnf-4.2.23-4.el8.noarch", "Installed: python3-dnf-plugins-core-4.0.17-5.el8.noarch", "Installed: sysstat-11.7.3-5.el8.x86_64", "Installed: seavgabios-bin-1.13.0-2.module_el8.3.0+555+a55c8938.noarch", "Removed: python3-virtualenv-15.1.0-19.module_el8.1.0+245+c39af44f.noarch", "Removed: openssl-1:1.1.1c-15.el8.x86_64", "Removed: qemu-img-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm- 2021-02-06T22:48:27.968 INFO:teuthology.task.ansible.out:common-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: qemu-kvm-core-15:2.12.0-88.module_el8.1.0+297+df420408.3.x86_64", "Removed: openssl-libs-1:1.1.1c-15.el8.x86_64", "Removed: librepo-1.11.0-2.el8.x86_64", "Removed: libsmartcols-2.32.1-22.el8.x86_64", "Removed: gcc-8.3.1-4.5.el8.x86_64", "Removed: gcc-gdb-plugin-8.3.1-4.5.el8.x86_64", "Removed: gdb-8.2-6.el8.x86_64", "Removed: gdb-headless-8.2-6.el8.x86_64", "Removed: seavgabios-bin-1.11.1-4.module_el8.1.0+248+298dec18.noarch", "Removed: boost-chrono-1.66.0-6.el8.x86_64", "Removed: git-2.18.2-2.el8_1.x86_64", "Removed: git-core-2.18.2-2.el8_1.x86_64", "Removed: git-core-doc-2.18.2-2.el8_1.noarch", "Removed: boost-system-1.66.0-6.el8.x86_64", "Removed: boost-thread-1.66.0-6.el8.x86_64", "Removed: libuuid-2.32.1-22.el8.x86_64", "Removed: podman-1.6.4-4.module_el8.1.0+298+41f9343a.x86_64", "Removed: podman-docker-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: podman-manpages-1.6.4-4.module_el8.1.0+298+41f9343a.noarch", "Removed: libblkid-2.32.1-22.el8.x86_64", "Removed: libdnf-0.35.1-9.el8_1.x86_64", "Removed: perl-Git-2.18.2-2.el8_1.noarch", "Removed: lsof-4.91-2.el8.x86_64", "Removed: cpp-8.3.1-4.5.el8.x86_64", "Removed: sysstat-11.7.3-2.el8.x86_64", "Removed: libfdisk-2.32.1-22.el8.x86_64", "Removed: python3-dnf-4.2.7-7.el8_1.noarch", "Removed: python3-dnf-plugins-core-4.0.8-3.el8.noarch", "Removed: libgcc-8.3.1-5.el8.0.2.x86_64", "Removed: libgcrypt-1.8.3-4.el8.x86_64", "Removed: python3-hawkey-0.35.1-9.el8_1.x86_64", "Removed: libgomp-8.3.1-4.5.el8.x86_64", "Removed: python3-libdnf-0.35.1-9.el8_1.x86_64", "Removed: python3-librepo-1.11.0-2.el8.x86_64", "Removed: util-linux-2.32.1-22.el8.x86_64", "Removed: util-linux-user-2.32.1-22.el8.x86_64", "Removed: valgrind-1:3.15.0-9.el8.x86_64", "Removed: python3-nose-1.3.7-30.module_el8.1.0+245+c39af44f.noarch", "Removed: dnf-4.2.7-7.el8_1.noarch", "Removed: dnf-data-4.2.7-7.el8_1.noarch", "Removed: libmount-2.32.1-22.el8.x86_64", "Removed: dnf-plu 2021-02-06T22:48:27.970 INFO:teuthology.task.ansible.out:gins-core-4.0.8-3.el8.noarch", "Removed: nfs-utils-1:2.3.3-26.el8.x86_64", "Removed: xfsprogs-5.0.0-2.el8.x86_64", "Removed: yum-4.2.7-7.el8_1.noarch", "Removed: yum-utils-4.0.8-3.el8.noarch"]} 2021-02-06T22:48:28.000 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:27 +0000 (0:00:01.542) 0:04:13.685 ***** 2021-02-06T22:48:28.027 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-06T22:48:28.029 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:28.066 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:28 +0000 (0:00:00.065) 0:04:13.751 ***** 2021-02-06T22:48:29.450 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-06T22:48:29.452 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-06T22:48:29.487 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:29 +0000 (0:00:01.421) 0:04:15.172 ***** 2021-02-06T22:48:29.535 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-06T22:48:29.536 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:29.571 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:29 +0000 (0:00:00.083) 0:04:15.256 ***** 2021-02-06T22:48:29.890 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-06T22:48:29.891 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket sysinit.target dbus.service system.slice polkit.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ipset.service ip6tables.service shutdown.target iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNode 2021-02-06T22:48:29.893 INFO:teuthology.task.ansible.out:s": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127286", "LimitNPROCSoft": "127286", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "L 2021-02-06T22:48:29.895 INFO:teuthology.task.ansible.out:imitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127286", "LimitSIGPENDINGSoft": "127286", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket sysinit.target system.slice", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWe 2021-02-06T22:48:29.896 INFO:teuthology.task.ansible.out:ight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203657", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-06T22:48:29.927 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:29 +0000 (0:00:00.356) 0:04:15.612 ***** 2021-02-06T22:48:30.226 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-06T22:48:30.227 INFO:teuthology.task.ansible.out:fatal: [smithi051.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-06T22:48:30.260 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.333) 0:04:15.945 ***** 2021-02-06T22:48:30.559 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-06T22:48:30.560 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-06T22:48:30.594 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.333) 0:04:16.279 ***** 2021-02-06T22:48:30.621 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.655 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.061) 0:04:16.340 ***** 2021-02-06T22:48:30.683 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-06T22:48:30.684 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.718 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.062) 0:04:16.402 ***** 2021-02-06T22:48:30.744 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-06T22:48:30.746 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.778 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.060) 0:04:16.463 ***** 2021-02-06T22:48:30.805 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-06T22:48:30.806 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.839 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.060) 0:04:16.524 ***** 2021-02-06T22:48:30.876 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-06T22:48:30.878 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.910 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.071) 0:04:16.595 ***** 2021-02-06T22:48:30.937 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-06T22:48:30.939 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:30.970 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:30 +0000 (0:00:00.060) 0:04:16.655 ***** 2021-02-06T22:48:31.009 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-06T22:48:31.047 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.076) 0:04:16.732 ***** 2021-02-06T22:48:31.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-06T22:48:31.076 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.108 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.060) 0:04:16.793 ***** 2021-02-06T22:48:31.136 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-06T22:48:31.138 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.169 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.061) 0:04:16.854 ***** 2021-02-06T22:48:31.208 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-06T22:48:31.210 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.219 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.254 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.084) 0:04:16.939 ***** 2021-02-06T22:48:31.282 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.318 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.064) 0:04:17.003 ***** 2021-02-06T22:48:31.347 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-06T22:48:31.385 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.066) 0:04:17.070 ***** 2021-02-06T22:48:31.422 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-06T22:48:31.424 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.459 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.073) 0:04:17.144 ***** 2021-02-06T22:48:31.487 INFO:teuthology.task.ansible.out: 2021-02-06T22:48:31.489 INFO:teuthology.task.ansible.out:TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.525 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.066) 0:04:17.210 ***** 2021-02-06T22:48:31.554 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-06T22:48:31.556 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.597 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.071) 0:04:17.282 ***** 2021-02-06T22:48:31.624 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-06T22:48:31.626 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.660 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.063) 0:04:17.345 ***** 2021-02-06T22:48:31.678 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-06T22:48:31.681 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-06T22:48:31.716 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.055) 0:04:17.401 ***** 2021-02-06T22:48:31.723 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-06T22:48:31.725 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.760 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.044) 0:04:17.445 ***** 2021-02-06T22:48:31.767 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-06T22:48:31.769 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356023296, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137701, 'block_used': 12957407, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137701, "block_size": 4096, "block_total": 240095108, "block_used": 12957407, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356023296, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}} 2021-02-06T22:48:31.802 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.041) 0:04:17.487 ***** 2021-02-06T22:48:31.810 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:31.811 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.847 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.044) 0:04:17.532 ***** 2021-02-06T22:48:31.875 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-06T22:48:31.877 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.909 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.062) 0:04:17.594 ***** 2021-02-06T22:48:31.936 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-06T22:48:31.937 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:31.970 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:31 +0000 (0:00:00.060) 0:04:17.655 ***** 2021-02-06T22:48:32.001 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-06T22:48:32.003 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005165", "end": "2021-02-06 22:48:31.980095", "rc": 0, "start": "2021-02-06 22:48:31.974930", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:32.040 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.069) 0:04:17.725 ***** 2021-02-06T22:48:32.047 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-06T22:48:32.048 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.082 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.042) 0:04:17.767 ***** 2021-02-06T22:48:32.089 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-06T22:48:32.091 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356023296, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137701, 'block_used': 12957407, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137701, "block_size": 4096, "block_total": 240095108, "block_used": 12957407, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356023296, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.125 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.042) 0:04:17.810 ***** 2021-02-06T22:48:32.131 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-06T22:48:32.133 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.167 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.041) 0:04:17.851 ***** 2021-02-06T22:48:32.173 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-06T22:48:32.208 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.041) 0:04:17.893 ***** 2021-02-06T22:48:32.214 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-06T22:48:32.216 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.250 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.042) 0:04:17.935 ***** 2021-02-06T22:48:32.278 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-06T22:48:32.280 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.311 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.061) 0:04:17.996 ***** 2021-02-06T22:48:32.339 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-06T22:48:32.340 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.375 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.063) 0:04:18.060 ***** 2021-02-06T22:48:32.402 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-06T22:48:32.404 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.437 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.062) 0:04:18.122 ***** 2021-02-06T22:48:32.464 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-06T22:48:32.466 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.499 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.061) 0:04:18.184 ***** 2021-02-06T22:48:32.527 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-06T22:48:32.529 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.565 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.066) 0:04:18.250 ***** 2021-02-06T22:48:32.592 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-06T22:48:32.594 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.627 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.061) 0:04:18.312 ***** 2021-02-06T22:48:32.653 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-06T22:48:32.655 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.688 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.061) 0:04:18.373 ***** 2021-02-06T22:48:32.717 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-06T22:48:32.719 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.751 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.062) 0:04:18.436 ***** 2021-02-06T22:48:32.777 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-06T22:48:32.779 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.812 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.061) 0:04:18.497 ***** 2021-02-06T22:48:32.841 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-06T22:48:32.843 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.876 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.063) 0:04:18.561 ***** 2021-02-06T22:48:32.914 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-06T22:48:32.916 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:32.952 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:32 +0000 (0:00:00.075) 0:04:18.637 ***** 2021-02-06T22:48:32.978 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:33.019 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.066) 0:04:18.704 ***** 2021-02-06T22:48:33.046 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-06T22:48:33.047 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:33.080 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.061) 0:04:18.765 ***** 2021-02-06T22:48:33.107 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-06T22:48:33.109 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:33.140 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.059) 0:04:18.825 ***** 2021-02-06T22:48:33.167 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-06T22:48:33.169 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:33.201 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.060) 0:04:18.886 ***** 2021-02-06T22:48:33.228 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-06T22:48:33.229 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:33.261 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.059) 0:04:18.946 ***** 2021-02-06T22:48:33.476 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:33.478 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-02-06T22:48:33.511 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.250) 0:04:19.196 ***** 2021-02-06T22:48:33.728 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-06T22:48:33.729 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:48:33.778 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:33 +0000 (0:00:00.266) 0:04:19.462 ***** 2021-02-06T22:48:33.984 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-06T22:48:33.986 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-02-06T22:48:34.019 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.241) 0:04:19.704 ***** 2021-02-06T22:48:34.046 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.079 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.059) 0:04:19.764 ***** 2021-02-06T22:48:34.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-06T22:48:34.107 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.142 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.060) 0:04:19.824 ***** 2021-02-06T22:48:34.156 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:34.158 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEo6Y7xundYzjYFi3ehTMenQe3C90c5uaFz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.720321", "end": "2021-02-06 22:48:34.118160", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEo6Y7xundYzjYFi3ehTMenQe3C90c5uaFz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:32.397839", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:34.168 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-06T22:48:34.170 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.203 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.063) 0:04:19.888 ***** 2021-02-06T22:48:34.230 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:34.232 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.264 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.060) 0:04:19.949 ***** 2021-02-06T22:48:34.307 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-06T22:48:34.309 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.340 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.075) 0:04:20.025 ***** 2021-02-06T22:48:34.367 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-06T22:48:34.369 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.406 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.065) 0:04:20.090 ***** 2021-02-06T22:48:34.433 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-06T22:48:34.434 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.469 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.063) 0:04:20.154 ***** 2021-02-06T22:48:34.496 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.532 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.063) 0:04:20.217 ***** 2021-02-06T22:48:34.559 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-06T22:48:34.561 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.594 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.062) 0:04:20.279 ***** 2021-02-06T22:48:34.621 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.655 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.060) 0:04:20.340 ***** 2021-02-06T22:48:34.682 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-06T22:48:34.683 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.722 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.067) 0:04:20.407 ***** 2021-02-06T22:48:34.750 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-06T22:48:34.752 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.785 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.062) 0:04:20.470 ***** 2021-02-06T22:48:34.812 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-06T22:48:34.814 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.846 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.061) 0:04:20.531 ***** 2021-02-06T22:48:34.873 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-06T22:48:34.875 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.909 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.062) 0:04:20.594 ***** 2021-02-06T22:48:34.936 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-06T22:48:34.938 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:34.971 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:34 +0000 (0:00:00.062) 0:04:20.656 ***** 2021-02-06T22:48:34.998 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-06T22:48:35.000 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.031 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.060) 0:04:20.716 ***** 2021-02-06T22:48:35.058 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-06T22:48:35.060 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.092 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.060) 0:04:20.777 ***** 2021-02-06T22:48:35.118 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-06T22:48:35.120 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.152 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.060) 0:04:20.837 ***** 2021-02-06T22:48:35.190 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-06T22:48:35.192 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.229 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.076) 0:04:20.914 ***** 2021-02-06T22:48:35.255 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-06T22:48:35.257 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.289 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.060) 0:04:20.974 ***** 2021-02-06T22:48:35.316 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-06T22:48:35.317 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.350 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.060) 0:04:21.035 ***** 2021-02-06T22:48:35.376 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-06T22:48:35.378 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.409 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.059) 0:04:21.094 ***** 2021-02-06T22:48:35.416 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:35.416 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Xef0N7-8WkB-zcej-CuVf-aE6G-Jm4z-L08Fie', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.047892", "end": "2021-02-06 22:48:35.355934", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Xef0N7-8WkB-zcej-CuVf-aE6G-Jm4z-L08Fie", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:34.308042", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2021-02-06T22:48:35.418 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:35.439 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:35.441 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-06T22:48:35.473 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.064) 0:04:21.158 ***** 2021-02-06T22:48:35.512 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-06T22:48:35.513 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.523 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-06T22:48:35.535 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.536 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.546 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.557 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.558 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.596 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.123) 0:04:21.281 ***** 2021-02-06T22:48:35.792 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-06T22:48:35.794 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005357", "end": "2021-02-06 22:48:35.762557", "rc": 0, "start": "2021-02-06 22:48:35.757200", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/virtualenv/bin/teuthology-lock"]} 2021-02-06T22:48:35.832 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.235) 0:04:21.517 ***** 2021-02-06T22:48:35.860 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-06T22:48:35.861 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.898 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.065) 0:04:21.583 ***** 2021-02-06T22:48:35.925 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-06T22:48:35.927 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:35.959 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:35 +0000 (0:00:00.061) 0:04:21.644 ***** 2021-02-06T22:48:35.986 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-06T22:48:35.988 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:36.025 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:36 +0000 (0:00:00.065) 0:04:21.710 ***** 2021-02-06T22:48:36.051 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-06T22:48:36.053 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:36.085 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:36 +0000 (0:00:00.060) 0:04:21.770 ***** 2021-02-06T22:48:36.644 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:36.645 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEor2rodoItL65Bnj9BuODIOfEaI0evcJyw'], 'uuids': ['a3aeeb43-8122-4517-bfd4-59cc12dbe6c7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.074526", "end": "2021-02-06 22:48:36.619554", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEor2rodoItL65Bnj9BuODIOfEaI0evcJyw"], "labels": [], "masters": [], "uuids": ["a3aeeb43-8122-4517-bfd4-59cc12dbe6c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:35.545028", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:37.900 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEon8Fo13jn0AY2bBSdj2kBdHqssi6wo3VM'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.064760", "end": "2021-02-06 22:48:37.870954", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEon8Fo13jn0AY2bBSdj2kBdHqssi6wo3VM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:36.806194", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:39.142 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEodsvjAvYix6ksoAoZyaYTxvHAqlYadOcQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056495", "end": "2021-02-06 22:48:39.111808", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEodsvjAvYix6ksoAoZyaYTxvHAqlYadOcQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:38.055313", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:39.144 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ', 'scsi-35000c50091e1aea6', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QHPJ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1aea6', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'scsi-35000c50091e1aea6-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ", "scsi-35000c50091e1aea6", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-06T22:48:39.145 INFO:teuthology.task.ansible.out:Z1W5QHPJ-part1", "scsi-35000c50091e1aea6-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:40.384 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEoCCWkTj4eaplcyEWXGvWSWFtfDqF2JGlK'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055443", "end": "2021-02-06 22:48:40.361384", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEoCCWkTj4eaplcyEWXGvWSWFtfDqF2JGlK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:39.305941", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:40.434 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:40 +0000 (0:00:04.349) 0:04:26.119 ***** 2021-02-06T22:48:40.799 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:40.801 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEo6Y7xundYzjYFi3ehTMenQe3C90c5uaFz'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.143558", "end": "2021-02-06 22:48:40.775209", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEo6Y7xundYzjYFi3ehTMenQe3C90c5uaFz"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:40.631651", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140869 s, 819 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140869 s, 819 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:41.019 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Xef0N7-8WkB-zcej-CuVf-aE6G-Jm4z-L08Fie', 'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', 'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037598", "end": "2021-02-06 22:48:40.996093", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Xef0N7-8WkB-zcej-CuVf-aE6G-Jm4z-L08Fie", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:40.958495", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0349761 s, 3.3 GB/s", "std 2021-02-06T22:48:41.021 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349761 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:41.353 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEor2rodoItL65Bnj9BuODIOfEaI0evcJyw'], 'uuids': ['a3aeeb43-8122-4517-bfd4-59cc12dbe6c7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.144497", "end": "2021-02-06 22:48:41.325226", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEor2rodoItL65Bnj9BuODIOfEaI0evcJyw"], "labels": [], "masters": [], "uuids": ["a3aeeb43-8122-4517-bfd4-59cc12dbe6c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:41.180729", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.141856 s, 813 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.141856 s, 813 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:41.667 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEon8Fo13jn0AY2bBSdj2kBdHqssi6wo3VM'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.142826", "end": "2021-02-06 22:48:41.644996", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEon8Fo13jn0AY2bBSdj2kBdHqssi6wo3VM"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:41.502170", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.140166 s, 823 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.140166 s, 823 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:41.795 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-06T22:48:41.796 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper", "Installed: device-mapper-event-8:1.02.171-5.el8.x86_64", "Installed: lvm2-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-event-libs-8:1.02.171-5.el8.x86_64", "Installed: lvm2-libs-8:2.03.09-5.el8.x86_64", "Installed: device-mapper-libs-8:1.02.171-5.el8.x86_64", "Installed: device-mapper-8:1.02.171-5.el8.x86_64", "Removed: device-mapper-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-event-libs-8:1.02.169-3.el8.x86_64", "Removed: device-mapper-libs-8:1.02.169-3.el8.x86_64", "Removed: lvm2-8:2.03.08-3.el8.x86_64", "Removed: lvm2-libs-8:2.03.08-3.el8.x86_64"]} 2021-02-06T22:48:41.830 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:41 +0000 (0:00:01.395) 0:04:27.515 ***** 2021-02-06T22:48:41.878 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-06T22:48:41.880 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356076544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137714, 'block_used': 12957394, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137714, "block_size": 4096, "block_total": 240095108, "block_used": 12957394, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356076544, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}} 2021-02-06T22:48:41.913 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:41 +0000 (0:00:00.083) 0:04:27.598 ***** 2021-02-06T22:48:41.993 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:41.995 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEodsvjAvYix6ksoAoZyaYTxvHAqlYadOcQ'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.154473", "end": "2021-02-06 22:48:41.973995", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEodsvjAvYix6ksoAoZyaYTxvHAqlYadOcQ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:41.819522", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151849 s, 760 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151849 s, 760 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:42.007 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ', 'scsi-35000c50091e1aea6', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ', 'wwn-0x5000c50091e1aea6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5QHPJ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50091e1aea6', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ-part1', 'scsi-35000c50091e1aea6-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1', 'wwn-0x5000c50091e1aea6-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5QHPJ", "scsi-35000c50091e1aea6", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-06T22:48:42.008 INFO:teuthology.task.ansible.out:Z1W5QHPJ-part1", "scsi-35000c50091e1aea6-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:42.124 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-06T22:48:42.126 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005436", "end": "2021-02-06 22:48:42.108271", "rc": 0, "start": "2021-02-06 22:48:42.102835", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:42.158 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.244) 0:04:27.843 ***** 2021-02-06T22:48:42.196 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-06T22:48:42.198 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356076544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137714, 'block_used': 12957394, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137714, "block_size": 4096, "block_total": 240095108, "block_used": 12957394, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356076544, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:42.230 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.072) 0:04:27.915 ***** 2021-02-06T22:48:42.257 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-06T22:48:42.291 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.060) 0:04:27.976 ***** 2021-02-06T22:48:42.320 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:42.321 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEoCCWkTj4eaplcyEWXGvWSWFtfDqF2JGlK'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.142368", "end": "2021-02-06 22:48:42.299176", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-XHMr3W4lXJpnQo1K6CDo2xlOfdum3PEoCCWkTj4eaplcyEWXGvWSWFtfDqF2JGlK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:42.156808", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139712 s, 826 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139712 s, 826 MB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:42.376 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.084) 0:04:28.061 ***** 2021-02-06T22:48:42.613 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-06T22:48:42.615 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.046674", "end": "2021-02-06 22:48:42.590632", "rc": 0, "start": "2021-02-06 22:48:42.543958", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:42.656 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.279) 0:04:28.341 ***** 2021-02-06T22:48:42.896 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-06T22:48:42.898 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.051415", "end": "2021-02-06 22:48:42.876333", "rc": 0, "start": "2021-02-06 22:48:42.824918", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:42.932 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.276) 0:04:28.617 ***** 2021-02-06T22:48:42.960 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-06T22:48:43.000 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:42 +0000 (0:00:00.067) 0:04:28.685 ***** 2021-02-06T22:48:43.027 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-06T22:48:43.029 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.065 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.065) 0:04:28.750 ***** 2021-02-06T22:48:43.093 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-06T22:48:43.095 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.129 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.064) 0:04:28.814 ***** 2021-02-06T22:48:43.157 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-06T22:48:43.159 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.193 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.064) 0:04:28.878 ***** 2021-02-06T22:48:43.220 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-06T22:48:43.222 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.254 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.060) 0:04:28.939 ***** 2021-02-06T22:48:43.438 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-06T22:48:43.439 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:48:43.472 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.218) 0:04:29.157 ***** 2021-02-06T22:48:43.521 INFO:teuthology.task.ansible.out: 2021-02-06T22:48:43.522 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356023296, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137701, 'block_used': 12957407, 'inode_total': 61054976, 'inode_available': 60986350, 'inode_used': 68626, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137701, "block_size": 4096, "block_total": 240095108, "block_used": 12957407, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986350, "inode_total": 61054976, "inode_used": 68626, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356023296, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.557 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.084) 0:04:29.242 ***** 2021-02-06T22:48:43.584 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-06T22:48:43.586 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.618 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.060) 0:04:29.303 ***** 2021-02-06T22:48:43.644 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:43.646 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.678 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.059) 0:04:29.363 ***** 2021-02-06T22:48:43.705 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.740 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.061) 0:04:29.425 ***** 2021-02-06T22:48:43.766 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.800 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.060) 0:04:29.485 ***** 2021-02-06T22:48:43.826 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-06T22:48:43.828 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.862 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.062) 0:04:29.547 ***** 2021-02-06T22:48:43.889 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-06T22:48:43.890 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:43.922 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:43 +0000 (0:00:00.059) 0:04:29.607 ***** 2021-02-06T22:48:44.023 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:44.025 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAm9PtXXL0AbzuAKQhLMnkLLx047OabCEA'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.507742", "end": "2021-02-06 22:48:43.993785", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAm9PtXXL0AbzuAKQhLMnkLLx047OabCEA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:42.486043", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:44.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-06T22:48:44.624 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-06T22:48:44.664 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:44 +0000 (0:00:00.742) 0:04:30.349 ***** 2021-02-06T22:48:45.324 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:45.326 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:45.347 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:45.349 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-mbgsne-v37T-83fL-J6iY-3s7f-EzoZ-kr0fOI', 'nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN', 'nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD016T4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '3125627568', 'sectorsize': '512', 'size': '1.46 TB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.125973", "end": "2021-02-06 22:48:45.320731", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mbgsne-v37T-83fL-J6iY-3s7f-EzoZ-kr0fOI", "nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN", "nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD016T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3125627568", "sectorsize": "512", "size": "1.46 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:44.194758", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! Yo 2021-02-06T22:48:45.351 INFO:teuthology.task.ansible.out:u may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:45.672 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:45.673 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:46.005 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:46.350 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:46.644 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:46.646 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAkUcyzOMOjcFXL3eOCeGnmmNqChuMIM1r'], 'uuids': ['e9ee6c24-08c6-4e4c-a226-6a537443912d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.090716", "end": "2021-02-06 22:48:46.615395", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAkUcyzOMOjcFXL3eOCeGnmmNqChuMIM1r"], "labels": [], "masters": [], "uuids": ["e9ee6c24-08c6-4e4c-a226-6a537443912d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:45.524679", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:46.687 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:46.689 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:46.735 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:46 +0000 (0:00:02.071) 0:04:32.421 ***** 2021-02-06T22:48:46.930 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-06T22:48:46.932 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-06T22:48:46.973 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:46 +0000 (0:00:00.237) 0:04:32.658 ***** 2021-02-06T22:48:47.178 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-06T22:48:47.180 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:47.360 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:47.539 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:47.720 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:47.732 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:47.772 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:47 +0000 (0:00:00.798) 0:04:33.457 ***** 2021-02-06T22:48:47.799 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:47.833 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:47 +0000 (0:00:00.060) 0:04:33.518 ***** 2021-02-06T22:48:47.859 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-06T22:48:47.861 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:47.894 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:47 +0000 (0:00:00.061) 0:04:33.579 ***** 2021-02-06T22:48:48.020 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:48.022 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAZUzxPbF8cqQGSvoxvGiPfxDgVKL0JzYm'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.179098", "end": "2021-02-06 22:48:47.991311", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAZUzxPbF8cqQGSvoxvGiPfxDgVKL0JzYm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:46.812213", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:48.095 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-06T22:48:48.096 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:48:48.129 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:48 +0000 (0:00:00.234) 0:04:33.814 ***** 2021-02-06T22:48:48.167 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-06T22:48:48.169 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-06T22:48:48.203 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:48 +0000 (0:00:00.074) 0:04:33.888 ***** 2021-02-06T22:48:49.304 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:49.306 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRA5nRxz1tRfvMVdO4YcL1A6vxa9x4nBhMi'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.080280", "end": "2021-02-06 22:48:49.274683", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRA5nRxz1tRfvMVdO4YcL1A6vxa9x4nBhMi"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:48.194403", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:49.317 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX', 'scsi-35000c500871aa859', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX', 'wwn-0x5000c500871aa859'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HPJX', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500871aa859', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'scsi-35000c500871aa859-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX-part1', 'wwn-0x5000c500871aa859-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX", "scsi-35000c500871aa859", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX", "wwn-0x5000c500871aa859"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2021-02-06T22:48:49.318 INFO:teuthology.task.ansible.out:Z1W4HPJX-part1", "scsi-35000c500871aa859-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX-part1", "wwn-0x5000c500871aa859-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HPJX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871aa859"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:49.743 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-06T22:48:49.745 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true} 2021-02-06T22:48:49.780 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:49 +0000 (0:00:01.576) 0:04:35.465 ***** 2021-02-06T22:48:50.344 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-06T22:48:50.345 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-06T22:48:50.378 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.598) 0:04:36.063 ***** 2021-02-06T22:48:50.405 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-06T22:48:50.407 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.440 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.061) 0:04:36.125 ***** 2021-02-06T22:48:50.466 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-06T22:48:50.468 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.500 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.060) 0:04:36.185 ***** 2021-02-06T22:48:50.527 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.560 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.059) 0:04:36.245 ***** 2021-02-06T22:48:50.577 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-06T22:48:50.579 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAKRJAjsK7WRfqlUjVlzlTFvpHHMpmesmG'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.064656", "end": "2021-02-06 22:48:50.547429", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAKRJAjsK7WRfqlUjVlzlTFvpHHMpmesmG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:49.482773", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-06T22:48:50.585 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-06T22:48:50.587 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.619 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.058) 0:04:36.304 ***** 2021-02-06T22:48:50.651 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.032) 0:04:36.336 ***** 2021-02-06T22:48:50.690 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.723 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.072) 0:04:36.408 ***** 2021-02-06T22:48:50.750 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-06T22:48:50.751 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.784 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.060) 0:04:36.469 ***** 2021-02-06T22:48:50.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-06T22:48:50.812 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.844 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.060) 0:04:36.529 ***** 2021-02-06T22:48:50.871 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-06T22:48:50.872 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.905 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.061) 0:04:36.590 ***** 2021-02-06T22:48:50.932 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-06T22:48:50.933 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:50.967 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:50 +0000 (0:00:00.061) 0:04:36.652 ***** 2021-02-06T22:48:50.973 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:50.974 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAm9PtXXL0AbzuAKQhLMnkLLx047OabCEA'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.104751", "end": "2021-02-06 22:48:50.932267", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAm9PtXXL0AbzuAKQhLMnkLLx047OabCEA"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:50.827516", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10186 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10186 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:50.986 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-06T22:48:50.988 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.019 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.051) 0:04:36.704 ***** 2021-02-06T22:48:51.046 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-06T22:48:51.047 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.078 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.059) 0:04:36.763 ***** 2021-02-06T22:48:51.105 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-06T22:48:51.107 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.139 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.060) 0:04:36.824 ***** 2021-02-06T22:48:51.166 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.205 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.065) 0:04:36.890 ***** 2021-02-06T22:48:51.211 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:51.212 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-mbgsne-v37T-83fL-J6iY-3s7f-EzoZ-kr0fOI', 'nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN', 'nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD016T4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '3125627568', 'sectorsize': '512', 'size': '1.46 TB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036994", "end": "2021-02-06 22:48:51.155727", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mbgsne-v37T-83fL-J6iY-3s7f-EzoZ-kr0fOI", "nvme-INTEL_SSDPEDMD016T4_CVFT6011006A1P6DGN", "nvme-nvme.8086-43564654363031313030364131503644474e-494e54454c205353445045444d443031365434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD016T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3125627568", "sectorsize": "512", "size": "1.46 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:51.118733", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0340793 s, 3.4 GB/s", "stder 2021-02-06T22:48:51.214 INFO:teuthology.task.ansible.out:r_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340793 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:51.235 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-06T22:48:51.236 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.272 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.066) 0:04:36.957 ***** 2021-02-06T22:48:51.298 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-06T22:48:51.300 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:51.332 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.060) 0:04:37.017 ***** 2021-02-06T22:48:51.475 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:51.477 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAkUcyzOMOjcFXL3eOCeGnmmNqChuMIM1r'], 'uuids': ['e9ee6c24-08c6-4e4c-a226-6a537443912d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.110810", "end": "2021-02-06 22:48:51.452039", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAkUcyzOMOjcFXL3eOCeGnmmNqChuMIM1r"], "labels": [], "masters": [], "uuids": ["e9ee6c24-08c6-4e4c-a226-6a537443912d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:51.341229", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.10797 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.10797 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:51.768 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAZUzxPbF8cqQGSvoxvGiPfxDgVKL0JzYm'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.104573", "end": "2021-02-06 22:48:51.741919", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAZUzxPbF8cqQGSvoxvGiPfxDgVKL0JzYm"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:51.637346", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.101844 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.101844 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:51.790 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-06T22:48:51.792 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-06T22:48:51.824 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:51 +0000 (0:00:00.492) 0:04:37.509 ***** 2021-02-06T22:48:52.059 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:52.061 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRA5nRxz1tRfvMVdO4YcL1A6vxa9x4nBhMi'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.105027", "end": "2021-02-06 22:48:52.030743", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRA5nRxz1tRfvMVdO4YcL1A6vxa9x4nBhMi"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:51.925716", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.102181 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.102181 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:52.062 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX', 'scsi-35000c500871aa859', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX', 'wwn-0x5000c500871aa859'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4HPJX', 'removable' 2021-02-06T22:48:52.063 INFO:teuthology.task.ansible.out:: '0', 'support_discard': '0', 'wwn': '0x5000c500871aa859', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX-part1', 'scsi-35000c500871aa859-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX-part1', 'wwn-0x5000c500871aa859-part1'], 'uuids': ['a313f13c-d1e6-43a8-a40a-989733f55ee1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX", "scsi-35000c500871aa859", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX", "wwn-0x5000c500871aa859"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HPJX-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4HPJX-part1", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4HPJX-part1", "scsi-35000c500871aa859-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4HPJX-part1", "wwn-0x5000c500871aa859-part1"], "labels": [], "masters": [], "uuids": ["a313f13c-d1e6-43a8-a40a-989733f55ee1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sect 2021-02-06T22:48:52.065 INFO:teuthology.task.ansible.out:orsize": "512", "serial": "Z1W4HPJX", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871aa859"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:52.126 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-06T22:48:52.127 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-06 22:44:01 UTC", "ActiveEnterTimestampMonotonic": "13207367", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sntp.service system.slice tmp.mount ntpdate.service systemd-tmpfiles-setup.service -.mount ntpd.service systemd-journald.socket sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-06 22:44:00 UTC", "AssertTimestampMonotonic": "11831620", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-06 22:44:00 UTC", "ConditionTimestampMonotonic": "11831561", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0 2021-02-06T22:48:52.129 INFO:teuthology.task.ansible.out:", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "887", "ExecMainStartTimestamp": "Sat 2021-02-06 22:44:01 UTC", "ExecMainStartTimestampMonotonic": "13140518", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-06 22:44:00 UTC", "InactiveExitTimestampMonotonic": "11835711", "InvocationID": "85a928c2d88e4a9e937b489dc18cfeea", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity 2021-02-06T22:48:52.130 INFO:teuthology.task.ansible.out:", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127262", "LimitNPROCSoft": "127262", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127262", "LimitSIGPENDINGSoft": "127262", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "887", "MemoryAccounting": "yes", "MemoryCurrent": "3268608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOn 2021-02-06T22:48:52.132 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-06 22:44:01 UTC", "StateChangeTimestampMonotonic": "13207367", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203619", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-06 22:44:01 UTC", "WatchdogTimestampMonotonic": "13140528", "WatchdogUSec": "0"}} 2021-02-06T22:48:52.162 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.337) 0:04:37.847 ***** 2021-02-06T22:48:52.189 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:52.190 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-06T22:48:52.222 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.060) 0:04:37.907 ***** 2021-02-06T22:48:52.258 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:52.260 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-06T22:48:52.293 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.071) 0:04:37.978 ***** 2021-02-06T22:48:52.319 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-06T22:48:52.321 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:52.353 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.060) 0:04:38.038 ***** 2021-02-06T22:48:52.359 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-06T22:48:52.360 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAKRJAjsK7WRfqlUjVlzlTFvpHHMpmesmG'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.106255", "end": "2021-02-06 22:48:52.328621", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-59FTKivbbgFUu8A6zp5CuF3EOfO09MRAKRJAjsK7WRfqlUjVlzlTFvpHHMpmesmG"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-06 22:48:52.222366", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.103515 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.103515 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:52.377 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-06T22:48:52.379 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:52.411 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.057) 0:04:38.096 ***** 2021-02-06T22:48:52.443 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.031) 0:04:38.128 ***** 2021-02-06T22:48:52.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:52.506 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.063) 0:04:38.191 ***** 2021-02-06T22:48:52.670 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-06T22:48:52.672 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.066073", "end": "2021-02-06 22:48:52.646253", "rc": 0, "start": "2021-02-06 22:48:52.580180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:52.708 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.202) 0:04:38.394 ***** 2021-02-06T22:48:52.715 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-06T22:48:52.717 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-06T22:48:52.753 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.044) 0:04:38.438 ***** 2021-02-06T22:48:52.948 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-06T22:48:52.950 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052371", "end": "2021-02-06 22:48:52.931071", "rc": 0, "start": "2021-02-06 22:48:52.878700", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:52.984 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:52 +0000 (0:00:00.231) 0:04:38.669 ***** 2021-02-06T22:48:53.012 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-06T22:48:53.048 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.064) 0:04:38.733 ***** 2021-02-06T22:48:53.075 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-06T22:48:53.076 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.113 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.064) 0:04:38.798 ***** 2021-02-06T22:48:53.139 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-06T22:48:53.141 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.173 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.060) 0:04:38.858 ***** 2021-02-06T22:48:53.200 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-06T22:48:53.201 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.236 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.062) 0:04:38.921 ***** 2021-02-06T22:48:53.242 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-06T22:48:53.244 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-06T22:48:53.277 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.041) 0:04:38.962 ***** 2021-02-06T22:48:53.283 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-06T22:48:53.285 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.321 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.043) 0:04:39.006 ***** 2021-02-06T22:48:53.518 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-06T22:48:53.520 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-06T22:48:53.552 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.231) 0:04:39.237 ***** 2021-02-06T22:48:53.590 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-06T22:48:53.592 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930356076544, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227137714, 'block_used': 12957394, 'inode_total': 61054976, 'inode_available': 60986354, 'inode_used': 68622, 'uuid': 'a313f13c-d1e6-43a8-a40a-989733f55ee1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227137714, "block_size": 4096, "block_total": 240095108, "block_used": 12957394, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986354, "inode_total": 61054976, "inode_used": 68622, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930356076544, "size_total": 983429562368, "uuid": "a313f13c-d1e6-43a8-a40a-989733f55ee1"}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.625 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.073) 0:04:39.310 ***** 2021-02-06T22:48:53.652 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-06T22:48:53.654 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.686 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.060) 0:04:39.370 ***** 2021-02-06T22:48:53.712 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:53.714 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.747 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.061) 0:04:39.432 ***** 2021-02-06T22:48:53.784 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:48:53.785 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.821 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.074) 0:04:39.506 ***** 2021-02-06T22:48:53.848 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-06T22:48:53.850 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.882 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.060) 0:04:39.567 ***** 2021-02-06T22:48:53.908 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-06T22:48:53.910 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:53.942 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:53 +0000 (0:00:00.059) 0:04:39.627 ***** 2021-02-06T22:48:53.969 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-06T22:48:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:54.003 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.061) 0:04:39.688 ***** 2021-02-06T22:48:54.470 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-06T22:48:54.471 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-06T22:48:54.504 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.500) 0:04:40.189 ***** 2021-02-06T22:48:54.604 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-06T22:48:54.605 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-06T22:48:54.641 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.137) 0:04:40.326 ***** 2021-02-06T22:48:54.670 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-06T22:48:54.671 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:54.703 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.061) 0:04:40.388 ***** 2021-02-06T22:48:54.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-06T22:48:54.732 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-02-06T22:48:54.764 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.060) 0:04:40.449 ***** 2021-02-06T22:48:54.916 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:54.918 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:54.948 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-06T22:48:54.950 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-06T22:48:54.983 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:54 +0000 (0:00:00.219) 0:04:40.668 ***** 2021-02-06T22:48:55.011 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-06T22:48:55.012 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.046 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.062) 0:04:40.731 ***** 2021-02-06T22:48:55.072 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-06T22:48:55.074 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-06T22:48:55.106 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.060) 0:04:40.791 ***** 2021-02-06T22:48:55.133 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-06T22:48:55.135 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.167 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.060) 0:04:40.852 ***** 2021-02-06T22:48:55.257 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:55.258 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:55.362 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-06T22:48:55.364 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-06T22:48:55.399 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.232) 0:04:41.084 ***** 2021-02-06T22:48:55.583 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-06T22:48:55.584 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-06T22:48:55.617 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.218) 0:04:41.302 ***** 2021-02-06T22:48:55.624 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:55.625 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:55.646 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.681 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.063) 0:04:41.366 ***** 2021-02-06T22:48:55.710 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-06T22:48:55.711 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.721 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.732 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.734 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.771 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.089) 0:04:41.456 ***** 2021-02-06T22:48:55.809 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-06T22:48:55.811 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.820 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.831 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.833 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.866 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.095) 0:04:41.551 ***** 2021-02-06T22:48:55.893 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:55.930 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.063) 0:04:41.615 ***** 2021-02-06T22:48:55.957 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-06T22:48:55.959 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:55.997 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:55 +0000 (0:00:00.066) 0:04:41.682 ***** 2021-02-06T22:48:56.025 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-06T22:48:56.027 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.061 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.064) 0:04:41.746 ***** 2021-02-06T22:48:56.088 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-06T22:48:56.090 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.121 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.060) 0:04:41.806 ***** 2021-02-06T22:48:56.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-06T22:48:56.149 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.187 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.065) 0:04:41.872 ***** 2021-02-06T22:48:56.214 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-06T22:48:56.216 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.250 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.063) 0:04:41.935 ***** 2021-02-06T22:48:56.277 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-06T22:48:56.279 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.314 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.063) 0:04:41.999 ***** 2021-02-06T22:48:56.320 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-06T22:48:56.322 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-06T22:48:56.358 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.044) 0:04:42.043 ***** 2021-02-06T22:48:56.364 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:56.403 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.044) 0:04:42.088 ***** 2021-02-06T22:48:56.565 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-06T22:48:56.567 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-06T22:48:56.602 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:56 +0000 (0:00:00.199) 0:04:42.287 ***** 2021-02-06T22:48:56.619 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-06T22:48:56.620 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004889", "end": "2021-02-06 22:48:56.587021", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-06 22:48:56.582132", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:56.796 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002996", "end": "2021-02-06 22:48:56.766661", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-06 22:48:56.763665", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:56.818 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-06T22:48:56.819 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:56.975 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-06T22:48:56.977 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002901", "end": "2021-02-06 22:48:56.940202", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-06 22:48:56.937301", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:57.008 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-06T22:48:57.009 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:57.154 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-06T22:48:57.156 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003051", "end": "2021-02-06 22:48:57.124002", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-06 22:48:57.120951", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:48:57.190 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.588) 0:04:42.875 ***** 2021-02-06T22:48:57.197 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-06T22:48:57.199 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:57.220 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-06T22:48:57.255 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.064) 0:04:42.940 ***** 2021-02-06T22:48:57.376 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-06T22:48:57.377 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-06T22:48:57.388 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:57.429 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.173) 0:04:43.114 ***** 2021-02-06T22:48:57.446 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-06T22:48:57.448 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-06T22:48:57.481 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:57.513 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.084) 0:04:43.198 ***** 2021-02-06T22:48:57.545 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:57.578 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.064) 0:04:43.263 ***** 2021-02-06T22:48:57.783 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-06T22:48:57.785 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:48:57.816 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.238) 0:04:43.501 ***** 2021-02-06T22:48:57.853 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-06T22:48:57.855 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-06T22:48:57.887 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:57 +0000 (0:00:00.070) 0:04:43.572 ***** 2021-02-06T22:48:58.172 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi051.front.sepia.ceph.com] => {"changed": true} 2021-02-06T22:48:58.213 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.326) 0:04:43.898 ***** 2021-02-06T22:48:58.521 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-06T22:48:58.523 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-06T22:48:58.554 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.341) 0:04:44.239 ***** 2021-02-06T22:48:58.581 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-06T22:48:58.582 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.615 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.300 ***** 2021-02-06T22:48:58.641 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.675 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.360 ***** 2021-02-06T22:48:58.701 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-06T22:48:58.703 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.735 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.420 ***** 2021-02-06T22:48:58.761 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-06T22:48:58.763 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.796 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.481 ***** 2021-02-06T22:48:58.823 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.857 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.061) 0:04:44.542 ***** 2021-02-06T22:48:58.859 INFO:teuthology.task.ansible.out: 2021-02-06T22:48:58.884 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-06T22:48:58.886 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.918 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.603 ***** 2021-02-06T22:48:58.945 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-06T22:48:58.946 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:58.978 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:58 +0000 (0:00:00.060) 0:04:44.663 ***** 2021-02-06T22:48:59.005 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-06T22:48:59.007 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.038 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.059) 0:04:44.723 ***** 2021-02-06T22:48:59.066 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-06T22:48:59.067 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.098 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.060) 0:04:44.784 ***** 2021-02-06T22:48:59.125 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.158 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.059) 0:04:44.843 ***** 2021-02-06T22:48:59.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-06T22:48:59.186 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.218 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.060) 0:04:44.903 ***** 2021-02-06T22:48:59.245 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-06T22:48:59.247 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.279 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.060) 0:04:44.964 ***** 2021-02-06T22:48:59.306 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-06T22:48:59.308 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.340 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.060) 0:04:45.025 ***** 2021-02-06T22:48:59.376 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-06T22:48:59.378 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.413 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.073) 0:04:45.098 ***** 2021-02-06T22:48:59.440 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-06T22:48:59.441 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:48:59.474 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.060) 0:04:45.159 ***** 2021-02-06T22:48:59.958 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-06T22:48:59.960 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-06T22:48:59.993 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:48:59 +0000 (0:00:00.518) 0:04:45.678 ***** 2021-02-06T22:49:00.312 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-06T22:49:00.313 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-06 22:43:55 UTC", "ActiveEnterTimestampMonotonic": "16143363", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice ntpd.service systemd-tmpfiles-setup.service systemd-journald.socket -.mount basic.target tmp.mount sysinit.target ntpdate.service sntp.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-06 22:43:54 UTC", "AssertTimestampMonotonic": "14815679", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-06 22:43:54 UTC", "ConditionTimestampMonotonic": "14815610", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0 2021-02-06T22:49:00.315 INFO:teuthology.task.ansible.out:", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "907", "ExecMainStartTimestamp": "Sat 2021-02-06 22:43:55 UTC", "ExecMainStartTimestampMonotonic": "16013699", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-06 22:43:54 UTC", "InactiveExitTimestampMonotonic": "14853411", "InvocationID": "1ba8bee968de4e66a030000267b0ec6a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity 2021-02-06T22:49:00.317 INFO:teuthology.task.ansible.out:", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127286", "LimitNPROCSoft": "127286", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127286", "LimitSIGPENDINGSoft": "127286", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "907", "MemoryAccounting": "yes", "MemoryCurrent": "3436544", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOn 2021-02-06T22:49:00.318 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-06 22:43:55 UTC", "StateChangeTimestampMonotonic": "16143363", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203657", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-06 22:43:55 UTC", "WatchdogTimestampMonotonic": "16013720", "WatchdogUSec": "0"}} 2021-02-06T22:49:00.348 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.355) 0:04:46.033 ***** 2021-02-06T22:49:00.375 INFO:teuthology.task.ansible.out: 2021-02-06T22:49:00.376 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-06T22:49:00.409 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.060) 0:04:46.094 ***** 2021-02-06T22:49:00.445 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:49:00.447 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-06T22:49:00.480 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.071) 0:04:46.165 ***** 2021-02-06T22:49:00.506 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-06T22:49:00.508 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:00.541 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.060) 0:04:46.226 ***** 2021-02-06T22:49:00.567 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-06T22:49:00.569 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:00.601 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.060) 0:04:46.286 ***** 2021-02-06T22:49:00.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-06T22:49:00.629 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:00.660 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.059) 0:04:46.345 ***** 2021-02-06T22:49:00.865 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-06T22:49:00.866 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-06T22:49:00.899 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:00 +0000 (0:00:00.238) 0:04:46.584 ***** 2021-02-06T22:49:01.383 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-06T22:49:01.384 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-06T22:49:01.416 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:01 +0000 (0:00:00.516) 0:04:47.101 ***** 2021-02-06T22:49:02.544 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-06T22:49:02.545 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-06T22:49:02.583 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:02 +0000 (0:00:01.166) 0:04:48.268 ***** 2021-02-06T22:49:02.610 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-06T22:49:02.612 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:02.644 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:02 +0000 (0:00:00.060) 0:04:48.329 ***** 2021-02-06T22:49:02.670 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-06T22:49:02.672 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-02-06T22:49:02.709 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:02 +0000 (0:00:00.064) 0:04:48.394 ***** 2021-02-06T22:49:02.903 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-06T22:49:02.905 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-06T22:49:02.942 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:02 +0000 (0:00:00.232) 0:04:48.626 ***** 2021-02-06T22:49:02.969 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-06T22:49:02.971 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.003 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.061) 0:04:48.688 ***** 2021-02-06T22:49:03.040 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-06T22:49:03.042 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-06T22:49:03.074 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.070) 0:04:48.759 ***** 2021-02-06T22:49:03.100 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-06T22:49:03.102 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.134 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.060) 0:04:48.819 ***** 2021-02-06T22:49:03.338 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-06T22:49:03.340 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-06T22:49:03.373 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.238) 0:04:49.058 ***** 2021-02-06T22:49:03.567 INFO:teuthology.task.ansible.out: 2021-02-06T22:49:03.567 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-06T22:49:03.569 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-06T22:49:03.603 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.230) 0:04:49.288 ***** 2021-02-06T22:49:03.640 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-06T22:49:03.642 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.677 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.073) 0:04:49.362 ***** 2021-02-06T22:49:03.714 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-06T22:49:03.716 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.726 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.727 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.738 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.785 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.108) 0:04:49.470 ***** 2021-02-06T22:49:03.824 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-06T22:49:03.826 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.836 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.847 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.849 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.886 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.101) 0:04:49.571 ***** 2021-02-06T22:49:03.914 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-06T22:49:03.916 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:03.962 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:03 +0000 (0:00:00.075) 0:04:49.647 ***** 2021-02-06T22:49:03.990 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-06T22:49:03.992 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.031 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.068) 0:04:49.716 ***** 2021-02-06T22:49:04.059 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.096 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.065) 0:04:49.781 ***** 2021-02-06T22:49:04.124 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-06T22:49:04.126 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.159 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.062) 0:04:49.844 ***** 2021-02-06T22:49:04.186 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-06T22:49:04.188 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.223 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.064) 0:04:49.908 ***** 2021-02-06T22:49:04.254 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-06T22:49:04.256 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.291 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.067) 0:04:49.976 ***** 2021-02-06T22:49:04.318 INFO:teuthology.task.ansible.out: 2021-02-06T22:49:04.320 INFO:teuthology.task.ansible.out:TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.378 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.087) 0:04:50.063 ***** 2021-02-06T22:49:04.409 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-06T22:49:04.411 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:04.443 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:04 +0000 (0:00:00.064) 0:04:50.128 ***** 2021-02-06T22:49:05.670 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-06T22:49:05.672 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:01.006682", "end": "2021-02-06 22:49:05.639661", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-06 22:49:04.632979", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:05.868 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003193", "end": "2021-02-06 22:49:05.840507", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-06 22:49:05.837314", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:06.055 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002995", "end": "2021-02-06 22:49:06.022243", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-06 22:49:06.019248", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:06.241 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.003304", "end": "2021-02-06 22:49:06.209088", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-06 22:49:06.205784", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:06.276 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:06 +0000 (0:00:01.832) 0:04:51.961 ***** 2021-02-06T22:49:06.303 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-06T22:49:06.337 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:06 +0000 (0:00:00.060) 0:04:52.022 ***** 2021-02-06T22:49:06.532 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-06T22:49:06.534 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-06T22:49:06.637 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-06T22:49:06.674 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:06 +0000 (0:00:00.336) 0:04:52.359 ***** 2021-02-06T22:49:06.707 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:06 +0000 (0:00:00.032) 0:04:52.392 ***** 2021-02-06T22:49:07.333 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi051.front.sepia.ceph.com] 2021-02-06T22:49:07.379 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2021-02-06T22:49:07.419 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.712) 0:04:53.104 ***** 2021-02-06T22:49:07.457 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:07.459 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:07.492 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.073) 0:04:53.177 ***** 2021-02-06T22:49:07.526 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.033) 0:04:53.211 ***** 2021-02-06T22:49:07.532 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:07.533 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-06T22:49:07.568 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.041) 0:04:53.253 ***** 2021-02-06T22:49:07.574 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:07.576 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:07.612 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.043) 0:04:53.297 ***** 2021-02-06T22:49:07.617 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-06T22:49:07.619 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-06T22:49:07.656 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.044) 0:04:53.341 ***** 2021-02-06T22:49:07.662 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:07.664 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-06T22:49:07.699 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.042) 0:04:53.384 ***** 2021-02-06T22:49:07.737 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-06T22:49:07.738 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-06T22:49:07.773 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:07 +0000 (0:00:00.073) 0:04:53.458 ***** 2021-02-06T22:49:08.753 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-06T22:49:08.755 INFO:teuthology.task.ansible.out:ok: [smithi051.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-06T22:49:08.794 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:08 +0000 (0:00:01.020) 0:04:54.479 ***** 2021-02-06T22:49:08.822 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} 2021-02-06T22:49:08.823 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi051.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-06T22:49:08.859 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:08 +0000 (0:00:00.065) 0:04:54.544 ***** 2021-02-06T22:49:08.892 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:08 +0000 (0:00:00.032) 0:04:54.577 ***** 2021-02-06T22:49:08.898 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:08.900 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:08.935 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:08 +0000 (0:00:00.043) 0:04:54.620 ***** 2021-02-06T22:49:08.942 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:08.944 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-02-06T22:49:08.980 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:08 +0000 (0:00:00.044) 0:04:54.665 ***** 2021-02-06T22:49:09.007 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-06T22:49:09.009 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:09.043 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:09 +0000 (0:00:00.063) 0:04:54.728 ***** 2021-02-06T22:49:09.165 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-06T22:49:09.167 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:49:09.260 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:49:09.366 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:49:09.406 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:09 +0000 (0:00:00.363) 0:04:55.091 ***** 2021-02-06T22:49:09.455 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-06T22:49:09.497 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:09 +0000 (0:00:00.091) 0:04:55.182 ***** 2021-02-06T22:49:09.943 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-06T22:49:09.945 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651749.449162-88758459399573/source", "state": "file", "uid": 0} 2021-02-06T22:49:10.019 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651749.5368404-138132893269862/source", "state": "file", "uid": 0} 2021-02-06T22:49:10.446 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651749.9508927-173240698827002/source", "state": "file", "uid": 0} 2021-02-06T22:49:10.486 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:10 +0000 (0:00:00.988) 0:04:56.171 ***** 2021-02-06T22:49:10.504 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1612651750.0290744-155588491407759/source", "state": "file", "uid": 0} 2021-02-06T22:49:10.543 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:10 +0000 (0:00:00.056) 0:04:56.228 ***** 2021-02-06T22:49:13.689 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-06T22:49:13.691 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-hdcu4svn-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-hdcu4svn-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-02-06T22:49:13.692 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-06T22:49:13.725 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:13 +0000 (0:00:03.182) 0:04:59.410 ***** 2021-02-06T22:49:13.751 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-06T22:49:13.753 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:13.791 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:13 +0000 (0:00:00.065) 0:04:59.476 ***** 2021-02-06T22:49:13.817 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:13.853 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:13 +0000 (0:00:00.062) 0:04:59.538 ***** 2021-02-06T22:49:13.859 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-06T22:49:13.861 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-5gjeooec-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-5gjeooec-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files. 2021-02-06T22:49:13.864 INFO:teuthology.task.ansible.out:pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-06T22:49:13.899 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:13 +0000 (0:00:00.045) 0:04:59.583 ***** 2021-02-06T22:49:13.926 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-06T22:49:13.927 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:13.961 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:13 +0000 (0:00:00.062) 0:04:59.646 ***** 2021-02-06T22:49:14.004 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-02-06T22:49:14.006 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:14.041 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:14 +0000 (0:00:00.079) 0:04:59.726 ***** 2021-02-06T22:49:14.215 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-06T22:49:14.217 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.166189", "end": "2021-02-06 22:49:14.191269", "rc": 0, "start": "2021-02-06 22:49:14.025080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:14.253 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:14 +0000 (0:00:00.211) 0:04:59.938 ***** 2021-02-06T22:49:14.282 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-06T22:49:14.284 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:14.418 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-06T22:49:14.420 INFO:teuthology.task.ansible.out:changed: [smithi051.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.170048", "end": "2021-02-06 22:49:14.392515", "rc": 0, "start": "2021-02-06 22:49:14.222467", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-06T22:49:14.457 INFO:teuthology.task.ansible.out:Saturday 06 February 2021 22:49:14 +0000 (0:00:00.204) 0:05:00.142 ***** 2021-02-06T22:49:14.485 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-06T22:49:14.487 INFO:teuthology.task.ansible.out:skipping: [smithi051.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-06T22:49:14.584 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-06T22:49:14.590 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-06T22:49:14.595 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-02-06T22:49:14.596 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi051.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 smithi106.front.sepia.ceph.com : ok=126 changed=46 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 Saturday 06 February 2021 22:49:14 +0000 (0:00:00.137) 0:05:00.280 ***** =============================================================================== common : nrpe - Ensure SELinux policy is up to date -------------------- 34.73s testnode : Install packages -------------------------------------------- 34.60s users : Create all admin users with sudo access. ----------------------- 30.18s users : Update authorized_keys using the keys repo --------------------- 27.26s common : nrpe - Remove SELinux policy package -------------------------- 11.28s common : nrpe - Load SELinux policy package ---------------------------- 10.34s users : Remove revoked users -------------------------------------------- 8.20s testnode : Make sure rpm dependencies are installed --------------------- 4.35s common : Install Kerberos Packages (RedHat) ----------------------------- 3.23s container-host : Install registries-conf-ctl ---------------------------- 3.18s common : nrpe - Install SELinux dependencies ---------------------------- 2.84s testnode : Ensure ceph packages are not present. ------------------------ 2.48s testnode : Ensure ceph dependency packages are not present. ------------- 2.24s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.83s 2021-02-06T22:49:14.597 INFO:teuthology.task.ansible.out:users : Update authorized_keys for each user with literal keys ---------- 1.82s Gathering Facts --------------------------------------------------------- 1.61s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 1.43s testnode : Remove packages ---------------------------------------------- 1.42s testnode : Install packages via pip ---------- 2021-02-06T22:49:14.599 INFO:teuthology.task.ansible.out:--------------------------- 1.17s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 1.12s 2021-02-06T22:49:14.905 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi051.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2021-02-06T22:49:14.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:49:14.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi051.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:49:14.981 DEBUG:teuthology.orchestra.run.smithi051:> true 2021-02-06T22:49:15.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-06T22:49:15.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-06T22:49:15.145 DEBUG:teuthology.orchestra.run.smithi106:> true 2021-02-06T22:49:15.242 INFO:teuthology.run_tasks:Running task clock... 2021-02-06T22:49:20.011 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-06T22:49:20.011 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-06T22:49:20.013 DEBUG:teuthology.orchestra.run.smithi051:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-06T22:49:20.054 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-06T22:49:20.071 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-06T22:49:20.112 INFO:teuthology.orchestra.run.smithi051.stderr:sudo: ntpd: command not found 2021-02-06T22:49:20.124 INFO:teuthology.orchestra.run.smithi051.stdout:506 Cannot talk to daemon 2021-02-06T22:49:20.141 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-06T22:49:20.157 INFO:teuthology.orchestra.run.smithi051.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-06T22:49:20.219 INFO:teuthology.orchestra.run.smithi051.stderr:bash: ntpq: command not found 2021-02-06T22:49:20.222 INFO:teuthology.orchestra.run.smithi051.stdout:210 Number of sources = 4 2021-02-06T22:49:20.222 INFO:teuthology.orchestra.run.smithi051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-06T22:49:20.222 INFO:teuthology.orchestra.run.smithi051.stdout:=============================================================================== 2021-02-06T22:49:20.222 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.223 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.223 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.223 INFO:teuthology.orchestra.run.smithi051.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-06T22:49:20.224 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-06T22:49:20.263 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-06T22:49:20.281 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-06T22:49:20.324 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2021-02-06T22:49:20.337 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2021-02-06T22:49:20.359 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-06T22:49:20.372 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-06T22:49:20.437 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2021-02-06T22:49:20.440 INFO:teuthology.orchestra.run.smithi106.stdout:210 Number of sources = 4 2021-02-06T22:49:20.441 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-06T22:49:20.441 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2021-02-06T22:49:20.441 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.441 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.441 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.442 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-06T22:49:20.442 INFO:teuthology.run_tasks:Running task install... 2021-02-06T22:49:20.455 DEBUG:teuthology.task.install:project ceph 2021-02-06T22:49:20.457 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc'}} 2021-02-06T22:49:20.458 DEBUG:teuthology.task.install:config {'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc'} 2021-02-06T22:49:20.458 INFO:teuthology.task.install:Using flavor: basic 2021-02-06T22:49:20.467 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-02-06T22:49:20.469 INFO:teuthology.task.install:extra packages: [] 2021-02-06T22:49:20.469 DEBUG:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2021-02-06T22:49:20.506 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2021-02-06T22:49:20.508 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:49:20.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-02-06T22:49:20.509 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc', 'tag': None, 'wait_for_package': False} 2021-02-06T22:49:20.509 DEBUG:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2021-02-06T22:49:20.546 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS 2021-02-06T22:49:20.548 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:49:20.548 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc', 'tag': None, 'wait_for_package': False} 2021-02-06T22:49:20.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-02-06T22:49:20.584 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2021-02-06T22:49:20.585 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:49:20.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=39ebd5ec4ebd7319faeb68d09b00b18fb45299cc 2021-02-06T22:49:20.623 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS 2021-02-06T22:49:20.625 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:49:20.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=39ebd5ec4ebd7319faeb68d09b00b18fb45299cc 2021-02-06T22:49:20.752 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/ 2021-02-06T22:49:20.753 INFO:teuthology.task.install.rpm:Package version is 16.1.0-114.g39ebd5ec 2021-02-06T22:49:20.787 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/ 2021-02-06T22:49:20.788 INFO:teuthology.task.install.rpm:Package version is 16.1.0-114.g39ebd5ec 2021-02-06T22:49:20.881 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-06T22:49:20.882 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:49:20.882 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-06T22:49:20.913 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2021-02-02-0942-pacific/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-06T22:49:20.913 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:49:20.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-06T22:49:20.915 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-02-06T22:49:20.915 DEBUG:teuthology.orchestra.run.smithi051:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-06T22:49:20.941 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-02-06T22:49:20.942 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-06T22:49:20.983 DEBUG:teuthology.orchestra.run.smithi051:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-06T22:49:21.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-06T22:49:21.061 DEBUG:teuthology.orchestra.run.smithi051:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-06T22:49:21.085 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-06T22:49:21.126 INFO:teuthology.orchestra.run.smithi051.stdout:check_obsoletes = 1 2021-02-06T22:49:21.128 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum clean all 2021-02-06T22:49:21.149 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2021-02-06T22:49:21.150 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2021-02-06T22:49:21.504 INFO:teuthology.orchestra.run.smithi106.stdout:107 files removed 2021-02-06T22:49:21.506 INFO:teuthology.orchestra.run.smithi051.stdout:107 files removed 2021-02-06T22:49:21.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw 2021-02-06T22:49:21.540 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-radosgw 2021-02-06T22:49:22.150 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 294 kB/s | 73 kB 00:00 2021-02-06T22:49:22.185 INFO:teuthology.orchestra.run.smithi051.stdout:ceph packages for x86_64 291 kB/s | 73 kB 00:00 2021-02-06T22:49:22.388 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 74 kB/s | 15 kB 00:00 2021-02-06T22:49:22.427 INFO:teuthology.orchestra.run.smithi051.stdout:ceph noarch packages 73 kB/s | 15 kB 00:00 2021-02-06T22:49:22.617 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 7.0 kB/s | 1.4 kB 00:00 2021-02-06T22:49:22.661 INFO:teuthology.orchestra.run.smithi051.stdout:ceph source packages 6.9 kB/s | 1.4 kB 00:00 2021-02-06T22:49:22.787 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - AppStream 43 MB/s | 6.3 MB 00:00 2021-02-06T22:49:22.839 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - AppStream 41 MB/s | 6.3 MB 00:00 2021-02-06T22:49:23.876 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - Base 24 MB/s | 2.3 MB 00:00 2021-02-06T22:49:24.008 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Base 23 MB/s | 2.3 MB 00:00 2021-02-06T22:49:24.321 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS-8 - Extras 134 kB/s | 8.6 kB 00:00 2021-02-06T22:49:24.480 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS-8 - Extras 132 kB/s | 8.6 kB 00:00 2021-02-06T22:49:24.757 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.8 MB 00:00 2021-02-06T22:49:24.866 INFO:teuthology.orchestra.run.smithi051.stdout:Extra Packages for Enterprise Linux 27 MB/s | 8.8 MB 00:00 2021-02-06T22:49:26.594 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2021-02-06T22:49:26.807 INFO:teuthology.orchestra.run.smithi051.stdout:lab-extras 5.0 MB/s | 24 kB 00:00 2021-02-06T22:49:27.722 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:49:27.735 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:49:27.735 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:49:27.735 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:49:27.735 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:49:27.736 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 12 M 2021-02-06T22:49:27.736 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2021-02-06T22:49:27.736 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.7 M 2021-02-06T22:49:27.736 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.2 M 2021-02-06T22:49:27.736 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:49:27.737 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 5.9 M 2021-02-06T22:49:27.737 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 24 M 2021-02-06T22:49:27.737 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 25 k 2021-02-06T22:49:27.737 INFO:teuthology.orchestra.run.smithi106.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-06T22:49:27.737 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2021-02-06T22:49:27.738 INFO:teuthology.orchestra.run.smithi106.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-06T22:49:27.738 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 792 k 2021-02-06T22:49:27.738 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-06T22:49:27.738 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-06T22:49:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 481 k 2021-02-06T22:49:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-06T22:49:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.9 M 2021-02-06T22:49:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-06T22:49:27.739 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-06T22:49:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 44 k 2021-02-06T22:49:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 77 k 2021-02-06T22:49:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 212 k 2021-02-06T22:49:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-06T22:49:27.740 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 387 k 2021-02-06T22:49:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 368 k 2021-02-06T22:49:27.741 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 114 k 2021-02-06T22:49:27.742 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:49:27.742 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:49:27.742 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:49:27.742 INFO:teuthology.orchestra.run.smithi106.stdout:Install 22 Packages 2021-02-06T22:49:27.742 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 2 Packages 2021-02-06T22:49:27.743 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:49:27.743 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 56 M 2021-02-06T22:49:27.744 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:49:27.996 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:49:28.007 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:49:28.007 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:49:28.007 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:49:28.008 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:49:28.008 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-radosgw x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 12 M 2021-02-06T22:49:28.008 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrading: 2021-02-06T22:49:28.008 INFO:teuthology.orchestra.run.smithi051.stdout: librados2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.7 M 2021-02-06T22:49:28.008 INFO:teuthology.orchestra.run.smithi051.stdout: librbd1 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.2 M 2021-02-06T22:49:28.009 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:49:28.009 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-base x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 5.9 M 2021-02-06T22:49:28.009 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-common x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 24 M 2021-02-06T22:49:28.009 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-selinux x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 25 k 2021-02-06T22:49:28.009 INFO:teuthology.orchestra.run.smithi051.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-06T22:49:28.010 INFO:teuthology.orchestra.run.smithi051.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2021-02-06T22:49:28.010 INFO:teuthology.orchestra.run.smithi051.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-06T22:49:28.010 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 792 k 2021-02-06T22:49:28.010 INFO:teuthology.orchestra.run.smithi051.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-06T22:49:28.011 INFO:teuthology.orchestra.run.smithi051.stdout: librabbitmq x86_64 0.9.0-2.el8 CentOS-Base 47 k 2021-02-06T22:49:28.011 INFO:teuthology.orchestra.run.smithi051.stdout: libradosstriper1 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 481 k 2021-02-06T22:49:28.011 INFO:teuthology.orchestra.run.smithi051.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-02-06T22:49:28.011 INFO:teuthology.orchestra.run.smithi051.stdout: librgw2 x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.9 M 2021-02-06T22:49:28.011 INFO:teuthology.orchestra.run.smithi051.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-06T22:49:28.012 INFO:teuthology.orchestra.run.smithi051.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-02-06T22:49:28.012 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-argparse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 44 k 2021-02-06T22:49:28.012 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-common x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 77 k 2021-02-06T22:49:28.012 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cephfs x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 212 k 2021-02-06T22:49:28.012 INFO:teuthology.orchestra.run.smithi051.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-02-06T22:49:28.013 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rados x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 387 k 2021-02-06T22:49:28.013 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rbd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 368 k 2021-02-06T22:49:28.013 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rgw x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 114 k 2021-02-06T22:49:28.013 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:49:28.013 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:49:28.014 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:49:28.014 INFO:teuthology.orchestra.run.smithi051.stdout:Install 22 Packages 2021-02-06T22:49:28.014 INFO:teuthology.orchestra.run.smithi051.stdout:Upgrade 2 Packages 2021-02-06T22:49:28.014 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:49:28.015 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 56 M 2021-02-06T22:49:28.015 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:49:28.447 INFO:teuthology.orchestra.run.smithi106.stdout:(1/24): ceph-base-16.1.0-114.g39ebd5ec.el8.x86_ 8.4 MB/s | 5.9 MB 00:00 2021-02-06T22:49:28.490 INFO:teuthology.orchestra.run.smithi106.stdout:(2/24): ceph-selinux-16.1.0-114.g39ebd5ec.el8.x 569 kB/s | 25 kB 00:00 2021-02-06T22:49:28.603 INFO:teuthology.orchestra.run.smithi106.stdout:(3/24): libcephfs2-16.1.0-114.g39ebd5ec.el8.x86 6.9 MB/s | 792 kB 00:00 2021-02-06T22:49:28.665 INFO:teuthology.orchestra.run.smithi106.stdout:(4/24): libradosstriper1-16.1.0-114.g39ebd5ec.e 7.6 MB/s | 481 kB 00:00 2021-02-06T22:49:29.086 INFO:teuthology.orchestra.run.smithi106.stdout:(5/24): librgw2-16.1.0-114.g39ebd5ec.el8.x86_64 9.4 MB/s | 3.9 MB 00:00 2021-02-06T22:49:29.139 INFO:teuthology.orchestra.run.smithi106.stdout:(6/24): python3-ceph-argparse-16.1.0-114.g39ebd 837 kB/s | 44 kB 00:00 2021-02-06T22:49:29.192 INFO:teuthology.orchestra.run.smithi106.stdout:(7/24): python3-ceph-common-16.1.0-114.g39ebd5e 1.4 MB/s | 77 kB 00:00 2021-02-06T22:49:29.250 INFO:teuthology.orchestra.run.smithi106.stdout:(8/24): python3-cephfs-16.1.0-114.g39ebd5ec.el8 3.6 MB/s | 212 kB 00:00 2021-02-06T22:49:29.318 INFO:teuthology.orchestra.run.smithi106.stdout:(9/24): python3-rados-16.1.0-114.g39ebd5ec.el8. 5.6 MB/s | 387 kB 00:00 2021-02-06T22:49:29.383 INFO:teuthology.orchestra.run.smithi106.stdout:(10/24): python3-rbd-16.1.0-114.g39ebd5ec.el8.x 5.5 MB/s | 368 kB 00:00 2021-02-06T22:49:29.441 INFO:teuthology.orchestra.run.smithi106.stdout:(11/24): python3-rgw-16.1.0-114.g39ebd5ec.el8.x 1.9 MB/s | 114 kB 00:00 2021-02-06T22:49:29.573 INFO:teuthology.orchestra.run.smithi106.stdout:(12/24): ceph-radosgw-16.1.0-114.g39ebd5ec.el8. 6.6 MB/s | 12 MB 00:01 2021-02-06T22:49:29.634 INFO:teuthology.orchestra.run.smithi106.stdout:(13/24): librdkafka-0.11.4-1.el8.x86_64.rpm 1.8 MB/s | 353 kB 00:00 2021-02-06T22:49:29.635 INFO:teuthology.orchestra.run.smithi106.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 27 MB/s | 44 kB 00:00 2021-02-06T22:49:29.637 INFO:teuthology.orchestra.run.smithi106.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.0 MB/s | 259 kB 00:00 2021-02-06T22:49:29.638 INFO:teuthology.orchestra.run.smithi106.stdout:(16/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 22 MB/s | 47 kB 00:00 2021-02-06T22:49:29.719 INFO:teuthology.orchestra.run.smithi106.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2021-02-06T22:49:29.735 INFO:teuthology.orchestra.run.smithi106.stdout:(18/24): gperftools-libs-2.7-6.el8.x86_64.rpm 3.2 MB/s | 315 kB 00:00 2021-02-06T22:49:29.752 INFO:teuthology.orchestra.run.smithi106.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 5.4 MB/s | 181 kB 00:00 2021-02-06T22:49:29.752 INFO:teuthology.orchestra.run.smithi106.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2021-02-06T22:49:29.768 INFO:teuthology.orchestra.run.smithi106.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2021-02-06T22:49:29.976 INFO:teuthology.orchestra.run.smithi106.stdout:(22/24): ceph-common-16.1.0-114.g39ebd5ec.el8.x 11 MB/s | 24 MB 00:02 2021-02-06T22:49:30.154 INFO:teuthology.orchestra.run.smithi106.stdout:(23/24): librados2-16.1.0-114.g39ebd5ec.el8.x86 9.2 MB/s | 3.7 MB 00:00 2021-02-06T22:49:30.249 INFO:teuthology.orchestra.run.smithi106.stdout:(24/24): librbd1-16.1.0-114.g39ebd5ec.el8.x86_6 6.7 MB/s | 3.2 MB 00:00 2021-02-06T22:49:30.252 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:49:30.253 INFO:teuthology.orchestra.run.smithi106.stdout:Total 22 MB/s | 56 MB 00:02 2021-02-06T22:49:30.256 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:49:30.300 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:49:30.301 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:49:30.396 INFO:teuthology.orchestra.run.smithi051.stdout:(1/24): ceph-base-16.1.0-114.g39ebd5ec.el8.x86_ 2.5 MB/s | 5.9 MB 00:02 2021-02-06T22:49:30.429 INFO:teuthology.orchestra.run.smithi051.stdout:(2/24): ceph-selinux-16.1.0-114.g39ebd5ec.el8.x 764 kB/s | 25 kB 00:00 2021-02-06T22:49:30.534 INFO:teuthology.orchestra.run.smithi051.stdout:(3/24): libcephfs2-16.1.0-114.g39ebd5ec.el8.x86 7.3 MB/s | 792 kB 00:00 2021-02-06T22:49:30.611 INFO:teuthology.orchestra.run.smithi051.stdout:(4/24): libradosstriper1-16.1.0-114.g39ebd5ec.e 6.2 MB/s | 481 kB 00:00 2021-02-06T22:49:30.620 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:49:30.623 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:49:31.032 INFO:teuthology.orchestra.run.smithi051.stdout:(5/24): ceph-radosgw-16.1.0-114.g39ebd5ec.el8.x 4.0 MB/s | 12 MB 00:03 2021-02-06T22:49:31.071 INFO:teuthology.orchestra.run.smithi051.stdout:(6/24): librgw2-16.1.0-114.g39ebd5ec.el8.x86_64 8.6 MB/s | 3.9 MB 00:00 2021-02-06T22:49:31.145 INFO:teuthology.orchestra.run.smithi051.stdout:(7/24): python3-ceph-argparse-16.1.0-114.g39ebd 393 kB/s | 44 kB 00:00 2021-02-06T22:49:31.146 INFO:teuthology.orchestra.run.smithi051.stdout:(8/24): python3-ceph-common-16.1.0-114.g39ebd5e 1.0 MB/s | 77 kB 00:00 2021-02-06T22:49:31.208 INFO:teuthology.orchestra.run.smithi051.stdout:(9/24): python3-cephfs-16.1.0-114.g39ebd5ec.el8 3.3 MB/s | 212 kB 00:00 2021-02-06T22:49:31.244 INFO:teuthology.orchestra.run.smithi051.stdout:(10/24): python3-rados-16.1.0-114.g39ebd5ec.el8 3.9 MB/s | 387 kB 00:00 2021-02-06T22:49:31.254 INFO:teuthology.orchestra.run.smithi051.stdout:(11/24): python3-rbd-16.1.0-114.g39ebd5ec.el8.x 7.8 MB/s | 368 kB 00:00 2021-02-06T22:49:31.288 INFO:teuthology.orchestra.run.smithi051.stdout:(12/24): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2021-02-06T22:49:31.289 INFO:teuthology.orchestra.run.smithi051.stdout:(13/24): python3-rgw-16.1.0-114.g39ebd5ec.el8.x 2.5 MB/s | 114 kB 00:00 2021-02-06T22:49:31.297 INFO:teuthology.orchestra.run.smithi051.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 29 MB/s | 259 kB 00:00 2021-02-06T22:49:31.299 INFO:teuthology.orchestra.run.smithi051.stdout:(15/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 34 MB/s | 47 kB 00:00 2021-02-06T22:49:31.319 INFO:teuthology.orchestra.run.smithi051.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 1.5 MB/s | 44 kB 00:00 2021-02-06T22:49:31.396 INFO:teuthology.orchestra.run.smithi051.stdout:(17/24): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2021-02-06T22:49:31.435 INFO:teuthology.orchestra.run.smithi051.stdout:(18/24): gperftools-libs-2.7-6.el8.x86_64.rpm 2.6 MB/s | 315 kB 00:00 2021-02-06T22:49:31.436 INFO:teuthology.orchestra.run.smithi051.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 4.4 MB/s | 181 kB 00:00 2021-02-06T22:49:31.455 INFO:teuthology.orchestra.run.smithi051.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2021-02-06T22:49:31.456 INFO:teuthology.orchestra.run.smithi051.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2021-02-06T22:49:31.626 INFO:teuthology.orchestra.run.smithi051.stdout:(22/24): ceph-common-16.1.0-114.g39ebd5ec.el8.x 6.5 MB/s | 24 MB 00:03 2021-02-06T22:49:31.725 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:49:31.756 INFO:teuthology.orchestra.run.smithi051.stdout:(23/24): librbd1-16.1.0-114.g39ebd5ec.el8.x86_6 11 MB/s | 3.2 MB 00:00 2021-02-06T22:49:31.774 INFO:teuthology.orchestra.run.smithi051.stdout:(24/24): librados2-16.1.0-114.g39ebd5ec.el8.x86 12 MB/s | 3.7 MB 00:00 2021-02-06T22:49:31.777 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:49:31.778 INFO:teuthology.orchestra.run.smithi051.stdout:Total 15 MB/s | 56 MB 00:03 2021-02-06T22:49:31.782 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:49:31.830 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:49:31.831 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:49:31.858 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-02-06T22:49:32.046 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-02-06T22:49:32.163 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:49:32.165 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:49:32.219 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-06T22:49:32.598 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-06T22:49:32.786 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:49:32.885 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:49:33.114 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/26 2021-02-06T22:49:33.244 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:49:33.349 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:49:33.483 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-02-06T22:49:33.575 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:49:33.672 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2021-02-06T22:49:33.719 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:49:33.824 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:49:33.860 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-06T22:49:33.976 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-02-06T22:49:34.118 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-06T22:49:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2021-02-06T22:49:34.499 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-06T22:49:34.561 INFO:teuthology.orchestra.run.smithi051.stdout: Upgrading : librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:49:34.644 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:49:34.664 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:49:34.713 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:49:34.880 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/26 2021-02-06T22:49:34.899 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-02-06T22:49:35.001 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:49:35.015 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x 12/26 2021-02-06T22:49:35.147 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 13/26 2021-02-06T22:49:35.345 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 14/26 2021-02-06T22:49:35.370 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:49:35.576 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 15/26 2021-02-06T22:49:35.668 INFO:teuthology.orchestra.run.smithi051.stdout: Upgrading : librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:49:35.685 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 16/26 2021-02-06T22:49:35.734 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:49:35.757 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 16/26 2021-02-06T22:49:35.911 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-02-06T22:49:35.972 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-02-06T22:49:36.026 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-06T22:49:36.169 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 18/26 2021-02-06T22:49:36.364 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-02-06T22:49:36.486 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-06T22:49:36.494 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86 20/26 2021-02-06T22:49:36.626 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:49:36.707 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:49:36.874 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-02-06T22:49:36.982 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x 12/26 2021-02-06T22:49:37.138 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 13/26 2021-02-06T22:49:37.304 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 14/26 2021-02-06T22:49:37.502 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 15/26 2021-02-06T22:49:37.659 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 16/26 2021-02-06T22:49:37.734 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 16/26 2021-02-06T22:49:37.946 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2021-02-06T22:49:38.136 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 18/26 2021-02-06T22:49:38.291 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-02-06T22:49:38.409 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86 20/26 2021-02-06T22:49:39.876 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:40.068 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:40.746 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:41.002 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 22/26 2021-02-06T22:49:41.090 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 22/26 2021-02-06T22:49:41.371 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:49:42.220 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:42.384 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:43.108 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 21/26 2021-02-06T22:49:43.370 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 22/26 2021-02-06T22:49:43.495 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 22/26 2021-02-06T22:49:43.600 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:49:58.007 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:49:58.007 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2021-02-06T22:49:58.007 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2021-02-06T22:49:58.008 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2021-02-06T22:49:58.008 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /run 2021-02-06T22:49:58.008 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2021-02-06T22:49:58.008 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2021-02-06T22:49:58.009 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2021-02-06T22:49:58.009 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2021-02-06T22:49:58.009 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2021-02-06T22:49:58.009 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:49:59.166 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 24/26 2021-02-06T22:49:59.250 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 24/26 2021-02-06T22:49:59.250 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-06T22:49:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-06T22:49:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/26 2021-02-06T22:50:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2/26 2021-02-06T22:50:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/26 2021-02-06T22:50:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:50:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/26 2021-02-06T22:50:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:50:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:50:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x 8/26 2021-02-06T22:50:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86 9/26 2021-02-06T22:50:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:50:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 11/26 2021-02-06T22:50:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 12/26 2021-02-06T22:50:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 13/26 2021-02-06T22:50:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-02-06T22:50:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-02-06T22:50:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-02-06T22:50:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-02-06T22:50:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-02-06T22:50:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 19/26 2021-02-06T22:50:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-02-06T22:50:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-02-06T22:50:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-02-06T22:50:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:50:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-02-06T22:50:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 25/26 2021-02-06T22:50:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:01.087 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2021-02-06T22:50:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:01.087 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-06T22:50:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-2.7-6.el8.x86_64 2021-02-06T22:50:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: leveldb-1.22-1.el8.x86_64 2021-02-06T22:50:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-06T22:50:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-06T22:50:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-06T22:50:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-06T22:50:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-06T22:50:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-06T22:50:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:01.092 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:01.101 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:50:01.101 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /sys 2021-02-06T22:50:01.102 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /proc 2021-02-06T22:50:01.102 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /dev 2021-02-06T22:50:01.102 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /run 2021-02-06T22:50:01.102 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /mnt 2021-02-06T22:50:01.102 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /var/tmp 2021-02-06T22:50:01.103 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /home 2021-02-06T22:50:01.103 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /tmp 2021-02-06T22:50:01.103 INFO:teuthology.orchestra.run.smithi051.stdout:skipping the directory /dev 2021-02-06T22:50:01.103 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:01.334 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-test 2021-02-06T22:50:01.800 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:35 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:02.243 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:02.244 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:02.244 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:02.244 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 50 M 2021-02-06T22:50:02.245 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:50:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-06T22:50:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-06T22:50:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-06T22:50:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-06T22:50:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-06T22:50:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:02.246 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:02.247 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:02.247 INFO:teuthology.orchestra.run.smithi106.stdout:Install 6 Packages 2021-02-06T22:50:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 51 M 2021-02-06T22:50:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 186 M 2021-02-06T22:50:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:02.280 INFO:teuthology.orchestra.run.smithi106.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.7 MB/s | 161 kB 00:00 2021-02-06T22:50:02.285 INFO:teuthology.orchestra.run.smithi106.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 53 MB/s | 302 kB 00:00 2021-02-06T22:50:02.286 INFO:teuthology.orchestra.run.smithi106.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.6 MB/s | 187 kB 00:00 2021-02-06T22:50:02.290 INFO:teuthology.orchestra.run.smithi106.stdout:(4/6): libxslt-1.1.32-5.el8.x86_64.rpm 63 MB/s | 250 kB 00:00 2021-02-06T22:50:02.352 INFO:teuthology.orchestra.run.smithi106.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2021-02-06T22:50:02.522 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 24/26 2021-02-06T22:50:02.611 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 24/26 2021-02-06T22:50:02.612 INFO:teuthology.orchestra.run.smithi051.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-06T22:50:02.807 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-06T22:50:02.808 INFO:teuthology.orchestra.run.smithi051.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:03.533 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:03.533 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/26 2021-02-06T22:50:03.533 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2/26 2021-02-06T22:50:03.534 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/26 2021-02-06T22:50:03.534 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/26 2021-02-06T22:50:03.534 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/26 2021-02-06T22:50:03.534 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/26 2021-02-06T22:50:03.535 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 7/26 2021-02-06T22:50:03.535 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x 8/26 2021-02-06T22:50:03.535 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86 9/26 2021-02-06T22:50:03.535 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 10/26 2021-02-06T22:50:03.535 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 11/26 2021-02-06T22:50:03.536 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 12/26 2021-02-06T22:50:03.536 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 13/26 2021-02-06T22:50:03.536 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/26 2021-02-06T22:50:03.536 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2021-02-06T22:50:03.536 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2021-02-06T22:50:03.537 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 17/26 2021-02-06T22:50:03.537 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2021-02-06T22:50:03.537 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 19/26 2021-02-06T22:50:03.537 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2021-02-06T22:50:03.537 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2021-02-06T22:50:03.538 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2021-02-06T22:50:03.538 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 23/26 2021-02-06T22:50:03.538 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-02-06T22:50:03.538 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 25/26 2021-02-06T22:50:04.497 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-02-06T22:50:04.497 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:04.498 INFO:teuthology.orchestra.run.smithi051.stdout:Upgraded: 2021-02-06T22:50:04.498 INFO:teuthology.orchestra.run.smithi051.stdout: librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.498 INFO:teuthology.orchestra.run.smithi051.stdout: librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.498 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:04.499 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:04.499 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.499 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.499 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-radosgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.499 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-selinux-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.500 INFO:teuthology.orchestra.run.smithi051.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-06T22:50:04.500 INFO:teuthology.orchestra.run.smithi051.stdout: gperftools-libs-2.7-6.el8.x86_64 2021-02-06T22:50:04.500 INFO:teuthology.orchestra.run.smithi051.stdout: leveldb-1.22-1.el8.x86_64 2021-02-06T22:50:04.500 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.500 INFO:teuthology.orchestra.run.smithi051.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-06T22:50:04.501 INFO:teuthology.orchestra.run.smithi051.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-06T22:50:04.501 INFO:teuthology.orchestra.run.smithi051.stdout: libradosstriper1-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.501 INFO:teuthology.orchestra.run.smithi051.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-06T22:50:04.501 INFO:teuthology.orchestra.run.smithi051.stdout: librgw2-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.502 INFO:teuthology.orchestra.run.smithi051.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-06T22:50:04.502 INFO:teuthology.orchestra.run.smithi051.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-06T22:50:04.502 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-argparse-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.502 INFO:teuthology.orchestra.run.smithi051.stdout: python3-ceph-common-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.502 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.503 INFO:teuthology.orchestra.run.smithi051.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-06T22:50:04.503 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.503 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.503 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:04.503 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:04.504 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:04.751 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-test 2021-02-06T22:50:05.243 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:39 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:05.742 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:05.744 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:05.744 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:50:05.744 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:05.744 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:05.744 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-test x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 50 M 2021-02-06T22:50:05.745 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:50:05.745 INFO:teuthology.orchestra.run.smithi051.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-02-06T22:50:05.745 INFO:teuthology.orchestra.run.smithi051.stdout: libxslt x86_64 1.1.32-5.el8 CentOS-Base 250 k 2021-02-06T22:50:05.745 INFO:teuthology.orchestra.run.smithi051.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-02-06T22:50:05.746 INFO:teuthology.orchestra.run.smithi051.stdout: socat x86_64 1.7.3.3-2.el8 CentOS-AppStream 302 k 2021-02-06T22:50:05.746 INFO:teuthology.orchestra.run.smithi051.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-06T22:50:05.746 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:05.746 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:05.746 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:05.747 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2021-02-06T22:50:05.747 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:05.748 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 51 M 2021-02-06T22:50:05.748 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 186 M 2021-02-06T22:50:05.748 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:05.782 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 4.4 MB/s | 161 kB 00:00 2021-02-06T22:50:05.787 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 56 MB/s | 302 kB 00:00 2021-02-06T22:50:05.788 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2021-02-06T22:50:05.791 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): libxslt-1.1.32-5.el8.x86_64.rpm 67 MB/s | 250 kB 00:00 2021-02-06T22:50:05.854 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2021-02-06T22:50:08.865 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): ceph-test-16.1.0-114.g39ebd5ec.el8.x86_6 16 MB/s | 50 MB 00:03 2021-02-06T22:50:08.868 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:08.869 INFO:teuthology.orchestra.run.smithi051.stdout:Total 16 MB/s | 51 MB 00:03 2021-02-06T22:50:08.874 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:08.900 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:08.901 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:09.010 INFO:teuthology.orchestra.run.smithi106.stdout:(6/6): ceph-test-16.1.0-114.g39ebd5ec.el8.x86_6 7.4 MB/s | 50 MB 00:06 2021-02-06T22:50:09.014 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:09.014 INFO:teuthology.orchestra.run.smithi106.stdout:Total 7.5 MB/s | 51 MB 00:06 2021-02-06T22:50:09.018 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:09.042 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:09.042 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:09.182 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:09.184 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:09.306 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:09.308 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:09.677 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:09.792 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:09.865 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-02-06T22:50:09.983 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-02-06T22:50:10.059 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-06T22:50:10.166 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-06T22:50:10.250 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2021-02-06T22:50:10.317 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 3/6 2021-02-06T22:50:10.387 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-06T22:50:10.489 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-06T22:50:10.499 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-06T22:50:10.569 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/6 2021-02-06T22:50:15.021 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2021-02-06T22:50:15.228 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/6 2021-02-06T22:50:15.325 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : jq-1.5-12.el8.x86_64 5/6 2021-02-06T22:50:15.464 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/6 2021-02-06T22:50:15.464 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/6 2021-02-06T22:50:15.464 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2021-02-06T22:50:15.464 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-06T22:50:15.465 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-02-06T22:50:15.465 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 5/6 2021-02-06T22:50:15.543 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/6 2021-02-06T22:50:15.807 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 6/6 2021-02-06T22:50:15.807 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/6 2021-02-06T22:50:15.807 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : jq-1.5-12.el8.x86_64 2/6 2021-02-06T22:50:15.807 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-06T22:50:15.808 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-02-06T22:50:15.808 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 5/6 2021-02-06T22:50:15.811 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2021-02-06T22:50:15.812 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:15.812 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:15.812 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 jq-1.5-12.el8.x86_64 2021-02-06T22:50:15.812 INFO:teuthology.orchestra.run.smithi106.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-02-06T22:50:15.813 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-02-06T22:50:15.813 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:15.813 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:15.894 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph 2021-02-06T22:50:16.279 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2021-02-06T22:50:16.280 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:16.280 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:16.280 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-test-2:16.1.0-114.g39ebd5ec.el8.x86_64 jq-1.5-12.el8.x86_64 2021-02-06T22:50:16.280 INFO:teuthology.orchestra.run.smithi051.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-02-06T22:50:16.280 INFO:teuthology.orchestra.run.smithi051.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-02-06T22:50:16.281 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:16.281 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:16.349 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:50 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:16.365 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph 2021-02-06T22:50:16.829 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:16.834 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2021-02-06T22:50:16.834 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:16.834 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2021-02-06T22:50:16.834 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 6.4 k 2021-02-06T22:50:16.835 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:50:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 2.4 M 2021-02-06T22:50:16.835 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 1.5 M 2021-02-06T22:50:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 204 k 2021-02-06T22:50:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 4.9 M 2021-02-06T22:50:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 18 M 2021-02-06T22:50:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-06T22:50:16.836 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-06T22:50:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-06T22:50:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-06T22:50:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-06T22:50:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-06T22:50:16.837 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-06T22:50:16.838 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-06T22:50:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-06T22:50:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-06T22:50:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-06T22:50:16.839 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-06T22:50:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-06T22:50:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-06T22:50:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-06T22:50:16.840 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-06T22:50:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-06T22:50:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-06T22:50:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-06T22:50:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-06T22:50:16.841 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-06T22:50:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-06T22:50:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-06T22:50:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-06T22:50:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-06T22:50:16.842 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-06T22:50:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-06T22:50:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-06T22:50:16.843 INFO:teuthology.orchestra.run.smithi106.stdout:Installing weak dependencies: 2021-02-06T22:50:16.843 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-06T22:50:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-06T22:50:16.844 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:16.844 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:16.844 INFO:teuthology.orchestra.run.smithi106.stdout:====================================================================================== 2021-02-06T22:50:16.844 INFO:teuthology.orchestra.run.smithi106.stdout:Install 36 Packages 2021-02-06T22:50:16.845 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:16.846 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:00:50 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:16.846 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 32 M 2021-02-06T22:50:16.846 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 103 M 2021-02-06T22:50:16.846 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:16.941 INFO:teuthology.orchestra.run.smithi106.stdout:(1/36): ceph-16.1.0-114.g39ebd5ec.el8.x86_64.rp 64 kB/s | 6.4 kB 00:00 2021-02-06T22:50:17.302 INFO:teuthology.orchestra.run.smithi106.stdout:(2/36): ceph-mgr-16.1.0-114.g39ebd5ec.el8.x86_6 3.3 MB/s | 1.5 MB 00:00 2021-02-06T22:50:17.330 INFO:teuthology.orchestra.run.smithi106.stdout:(3/36): ceph-mds-16.1.0-114.g39ebd5ec.el8.x86_6 4.9 MB/s | 2.4 MB 00:00 2021-02-06T22:50:17.389 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:17.391 INFO:teuthology.orchestra.run.smithi106.stdout:(4/36): ceph-mgr-modules-core-16.1.0-114.g39ebd 3.2 MB/s | 204 kB 00:00 2021-02-06T22:50:17.393 INFO:teuthology.orchestra.run.smithi051.stdout:====================================================================================== 2021-02-06T22:50:17.393 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:50:17.393 INFO:teuthology.orchestra.run.smithi051.stdout:====================================================================================== 2021-02-06T22:50:17.394 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:17.394 INFO:teuthology.orchestra.run.smithi051.stdout: ceph x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 6.4 k 2021-02-06T22:50:17.394 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:50:17.394 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mds x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 2.4 M 2021-02-06T22:50:17.394 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 1.5 M 2021-02-06T22:50:17.395 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-modules-core noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 204 k 2021-02-06T22:50:17.395 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mon x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 4.9 M 2021-02-06T22:50:17.395 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-osd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 18 M 2021-02-06T22:50:17.395 INFO:teuthology.orchestra.run.smithi051.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-06T22:50:17.395 INFO:teuthology.orchestra.run.smithi051.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-06T22:50:17.396 INFO:teuthology.orchestra.run.smithi051.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-02-06T22:50:17.396 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-06T22:50:17.396 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-06T22:50:17.396 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-06T22:50:17.396 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-06T22:50:17.397 INFO:teuthology.orchestra.run.smithi051.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-06T22:50:17.397 INFO:teuthology.orchestra.run.smithi051.stdout: python3-lxml x86_64 4.2.3-1.el8 CentOS-AppStream 1.5 M 2021-02-06T22:50:17.397 INFO:teuthology.orchestra.run.smithi051.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-02-06T22:50:17.397 INFO:teuthology.orchestra.run.smithi051.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-02-06T22:50:17.398 INFO:teuthology.orchestra.run.smithi051.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-06T22:50:17.398 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-06T22:50:17.398 INFO:teuthology.orchestra.run.smithi051.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-06T22:50:17.398 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-02-06T22:50:17.398 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-02-06T22:50:17.399 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-02-06T22:50:17.399 INFO:teuthology.orchestra.run.smithi051.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-06T22:50:17.399 INFO:teuthology.orchestra.run.smithi051.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-06T22:50:17.399 INFO:teuthology.orchestra.run.smithi051.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-06T22:50:17.399 INFO:teuthology.orchestra.run.smithi051.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-urllib3 noarch 1.24.2-4.el8 CentOS-Base 176 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-06T22:50:17.400 INFO:teuthology.orchestra.run.smithi051.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-02-06T22:50:17.401 INFO:teuthology.orchestra.run.smithi051.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-06T22:50:17.401 INFO:teuthology.orchestra.run.smithi051.stdout:Installing weak dependencies: 2021-02-06T22:50:17.401 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-06T22:50:17.401 INFO:teuthology.orchestra.run.smithi051.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-02-06T22:50:17.402 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:17.402 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:17.402 INFO:teuthology.orchestra.run.smithi051.stdout:====================================================================================== 2021-02-06T22:50:17.402 INFO:teuthology.orchestra.run.smithi051.stdout:Install 36 Packages 2021-02-06T22:50:17.402 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:17.403 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 32 M 2021-02-06T22:50:17.403 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 103 M 2021-02-06T22:50:17.404 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:17.423 INFO:teuthology.orchestra.run.smithi106.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.6 MB/s | 214 kB 00:00 2021-02-06T22:50:17.442 INFO:teuthology.orchestra.run.smithi106.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2021-02-06T22:50:17.444 INFO:teuthology.orchestra.run.smithi106.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 61 MB/s | 157 kB 00:00 2021-02-06T22:50:17.445 INFO:teuthology.orchestra.run.smithi106.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-02-06T22:50:17.446 INFO:teuthology.orchestra.run.smithi106.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2021-02-06T22:50:17.448 INFO:teuthology.orchestra.run.smithi106.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 25 MB/s | 27 kB 00:00 2021-02-06T22:50:17.454 INFO:teuthology.orchestra.run.smithi106.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 77 MB/s | 457 kB 00:00 2021-02-06T22:50:17.457 INFO:teuthology.orchestra.run.smithi106.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 66 MB/s | 195 kB 00:00 2021-02-06T22:50:17.458 INFO:teuthology.orchestra.run.smithi106.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 30 MB/s | 34 kB 00:00 2021-02-06T22:50:17.460 INFO:teuthology.orchestra.run.smithi106.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 59 MB/s | 123 kB 00:00 2021-02-06T22:50:17.466 INFO:teuthology.orchestra.run.smithi106.stdout:(15/36): python3-urllib3-1.24.2-4.el8.noarch.rp 30 MB/s | 176 kB 00:00 2021-02-06T22:50:17.546 INFO:teuthology.orchestra.run.smithi106.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 556 kB/s | 44 kB 00:00 2021-02-06T22:50:17.615 INFO:teuthology.orchestra.run.smithi106.stdout:(17/36): ceph-mon-16.1.0-114.g39ebd5ec.el8.x86_ 7.3 MB/s | 4.9 MB 00:00 2021-02-06T22:50:17.616 INFO:teuthology.orchestra.run.smithi106.stdout:(18/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.6 MB/s | 185 kB 00:00 2021-02-06T22:50:17.630 INFO:teuthology.orchestra.run.smithi051.stdout:(1/36): ceph-16.1.0-114.g39ebd5ec.el8.x86_64.rp 28 kB/s | 6.4 kB 00:00 2021-02-06T22:50:17.656 INFO:teuthology.orchestra.run.smithi106.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 9.3 MB/s | 384 kB 00:00 2021-02-06T22:50:17.676 INFO:teuthology.orchestra.run.smithi106.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.0 MB/s | 40 kB 00:00 2021-02-06T22:50:17.696 INFO:teuthology.orchestra.run.smithi106.stdout:(21/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.1 MB/s | 173 kB 00:00 2021-02-06T22:50:17.696 INFO:teuthology.orchestra.run.smithi106.stdout:(22/36): python3-jaraco-6.2-6.el8.noarch.rpm 567 kB/s | 11 kB 00:00 2021-02-06T22:50:17.712 INFO:teuthology.orchestra.run.smithi106.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 2.9 MB/s | 49 kB 00:00 2021-02-06T22:50:17.715 INFO:teuthology.orchestra.run.smithi106.stdout:(24/36): python3-jaraco-functools-2.0-4.el8.noa 892 kB/s | 18 kB 00:00 2021-02-06T22:50:17.729 INFO:teuthology.orchestra.run.smithi106.stdout:(25/36): python3-more-itertools-7.2.0-3.el8.noa 3.5 MB/s | 59 kB 00:00 2021-02-06T22:50:17.737 INFO:teuthology.orchestra.run.smithi106.stdout:(26/36): python3-pecan-1.3.2-9.el8.noarch.rpm 13 MB/s | 283 kB 00:00 2021-02-06T22:50:17.745 INFO:teuthology.orchestra.run.smithi106.stdout:(27/36): python3-portend-2.6-1.el8.noarch.rpm 961 kB/s | 16 kB 00:00 2021-02-06T22:50:17.757 INFO:teuthology.orchestra.run.smithi106.stdout:(28/36): python3-simplegeneric-0.8.1-17.el8.noa 960 kB/s | 19 kB 00:00 2021-02-06T22:50:17.762 INFO:teuthology.orchestra.run.smithi106.stdout:(29/36): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2021-02-06T22:50:17.776 INFO:teuthology.orchestra.run.smithi106.stdout:(30/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.4 MB/s | 29 kB 00:00 2021-02-06T22:50:17.780 INFO:teuthology.orchestra.run.smithi106.stdout:(31/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2021-02-06T22:50:17.798 INFO:teuthology.orchestra.run.smithi106.stdout:(32/36): python3-waitress-1.2.1-2.el8.1.noarch. 11 MB/s | 241 kB 00:00 2021-02-06T22:50:17.812 INFO:teuthology.orchestra.run.smithi106.stdout:(33/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 7.5 MB/s | 251 kB 00:00 2021-02-06T22:50:17.818 INFO:teuthology.orchestra.run.smithi106.stdout:(34/36): python3-webtest-2.0.33-1.el8.noarch.rp 4.2 MB/s | 85 kB 00:00 2021-02-06T22:50:17.828 INFO:teuthology.orchestra.run.smithi106.stdout:(35/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2021-02-06T22:50:18.250 INFO:teuthology.orchestra.run.smithi051.stdout:(2/36): ceph-mgr-16.1.0-114.g39ebd5ec.el8.x86_6 1.8 MB/s | 1.5 MB 00:00 2021-02-06T22:50:18.485 INFO:teuthology.orchestra.run.smithi051.stdout:(3/36): ceph-mds-16.1.0-114.g39ebd5ec.el8.x86_6 2.2 MB/s | 2.4 MB 00:01 2021-02-06T22:50:18.557 INFO:teuthology.orchestra.run.smithi051.stdout:(4/36): ceph-mgr-modules-core-16.1.0-114.g39ebd 2.8 MB/s | 204 kB 00:00 2021-02-06T22:50:18.590 INFO:teuthology.orchestra.run.smithi051.stdout:(5/36): python3-html5lib-0.999999999-6.el8.noar 6.4 MB/s | 214 kB 00:00 2021-02-06T22:50:18.609 INFO:teuthology.orchestra.run.smithi051.stdout:(6/36): python3-lxml-4.2.3-1.el8.x86_64.rpm 78 MB/s | 1.5 MB 00:00 2021-02-06T22:50:18.612 INFO:teuthology.orchestra.run.smithi051.stdout:(7/36): python3-mako-1.0.6-13.el8.noarch.rpm 61 MB/s | 157 kB 00:00 2021-02-06T22:50:18.613 INFO:teuthology.orchestra.run.smithi051.stdout:(8/36): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-02-06T22:50:18.614 INFO:teuthology.orchestra.run.smithi051.stdout:(9/36): python3-pytz-2017.2-9.el8.noarch.rpm 40 MB/s | 54 kB 00:00 2021-02-06T22:50:18.616 INFO:teuthology.orchestra.run.smithi051.stdout:(10/36): python3-webencodings-0.5.1-6.el8.noarc 20 MB/s | 27 kB 00:00 2021-02-06T22:50:18.622 INFO:teuthology.orchestra.run.smithi051.stdout:(11/36): python3-werkzeug-0.12.2-4.el8.noarch.r 75 MB/s | 457 kB 00:00 2021-02-06T22:50:18.625 INFO:teuthology.orchestra.run.smithi051.stdout:(12/36): python3-chardet-3.0.4-7.el8.noarch.rpm 64 MB/s | 195 kB 00:00 2021-02-06T22:50:18.626 INFO:teuthology.orchestra.run.smithi051.stdout:(13/36): python3-pysocks-1.6.8-3.el8.noarch.rpm 26 MB/s | 34 kB 00:00 2021-02-06T22:50:18.629 INFO:teuthology.orchestra.run.smithi051.stdout:(14/36): python3-requests-2.20.0-2.1.el8_1.noar 58 MB/s | 123 kB 00:00 2021-02-06T22:50:18.632 INFO:teuthology.orchestra.run.smithi051.stdout:(15/36): python3-urllib3-1.24.2-4.el8.noarch.rp 62 MB/s | 176 kB 00:00 2021-02-06T22:50:18.698 INFO:teuthology.orchestra.run.smithi051.stdout:(16/36): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 665 kB/s | 44 kB 00:00 2021-02-06T22:50:18.746 INFO:teuthology.orchestra.run.smithi051.stdout:(17/36): python3-beautifulsoup4-4.6.3-2.el8.1.n 3.7 MB/s | 185 kB 00:00 2021-02-06T22:50:18.764 INFO:teuthology.orchestra.run.smithi051.stdout:(18/36): python3-cheroot-8.5.2-1.el8.noarch.rpm 9.5 MB/s | 173 kB 00:00 2021-02-06T22:50:18.798 INFO:teuthology.orchestra.run.smithi051.stdout:(19/36): python3-cherrypy-18.4.0-1.el8.noarch.r 11 MB/s | 384 kB 00:00 2021-02-06T22:50:18.814 INFO:teuthology.orchestra.run.smithi051.stdout:(20/36): python3-cssselect-0.9.2-10.el8.noarch. 2.4 MB/s | 40 kB 00:00 2021-02-06T22:50:18.831 INFO:teuthology.orchestra.run.smithi051.stdout:(21/36): python3-jaraco-6.2-6.el8.noarch.rpm 679 kB/s | 11 kB 00:00 2021-02-06T22:50:18.847 INFO:teuthology.orchestra.run.smithi051.stdout:(22/36): python3-jaraco-functools-2.0-4.el8.noa 1.1 MB/s | 18 kB 00:00 2021-02-06T22:50:18.864 INFO:teuthology.orchestra.run.smithi051.stdout:(23/36): python3-logutils-0.3.5-11.el8.noarch.r 2.9 MB/s | 49 kB 00:00 2021-02-06T22:50:18.882 INFO:teuthology.orchestra.run.smithi051.stdout:(24/36): python3-more-itertools-7.2.0-3.el8.noa 3.3 MB/s | 59 kB 00:00 2021-02-06T22:50:18.900 INFO:teuthology.orchestra.run.smithi051.stdout:(25/36): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2021-02-06T22:50:18.916 INFO:teuthology.orchestra.run.smithi051.stdout:(26/36): python3-portend-2.6-1.el8.noarch.rpm 962 kB/s | 16 kB 00:00 2021-02-06T22:50:18.933 INFO:teuthology.orchestra.run.smithi051.stdout:(27/36): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2021-02-06T22:50:18.949 INFO:teuthology.orchestra.run.smithi051.stdout:(28/36): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2021-02-06T22:50:18.966 INFO:teuthology.orchestra.run.smithi051.stdout:(29/36): python3-tempora-1.14.1-5.el8.noarch.rp 1.7 MB/s | 29 kB 00:00 2021-02-06T22:50:18.983 INFO:teuthology.orchestra.run.smithi051.stdout:(30/36): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2021-02-06T22:50:19.001 INFO:teuthology.orchestra.run.smithi051.stdout:(31/36): python3-waitress-1.2.1-2.el8.1.noarch. 13 MB/s | 241 kB 00:00 2021-02-06T22:50:19.019 INFO:teuthology.orchestra.run.smithi051.stdout:(32/36): python3-webob-1.8.5-1.el8.1.noarch.rpm 14 MB/s | 251 kB 00:00 2021-02-06T22:50:19.036 INFO:teuthology.orchestra.run.smithi051.stdout:(33/36): python3-webtest-2.0.33-1.el8.noarch.rp 4.9 MB/s | 85 kB 00:00 2021-02-06T22:50:19.053 INFO:teuthology.orchestra.run.smithi051.stdout:(34/36): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2021-02-06T22:50:19.478 INFO:teuthology.orchestra.run.smithi051.stdout:(35/36): ceph-mon-16.1.0-114.g39ebd5ec.el8.x86_ 2.7 MB/s | 4.9 MB 00:01 2021-02-06T22:50:20.260 INFO:teuthology.orchestra.run.smithi106.stdout:(36/36): ceph-osd-16.1.0-114.g39ebd5ec.el8.x86_ 6.1 MB/s | 18 MB 00:02 2021-02-06T22:50:20.264 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:20.264 INFO:teuthology.orchestra.run.smithi106.stdout:Total 9.3 MB/s | 32 MB 00:03 2021-02-06T22:50:20.275 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:20.319 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:20.319 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:20.561 INFO:teuthology.orchestra.run.smithi051.stdout:(36/36): ceph-osd-16.1.0-114.g39ebd5ec.el8.x86_ 7.8 MB/s | 18 MB 00:02 2021-02-06T22:50:20.564 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:20.565 INFO:teuthology.orchestra.run.smithi051.stdout:Total 10 MB/s | 32 MB 00:03 2021-02-06T22:50:20.576 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:20.590 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:20.592 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:20.621 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:20.622 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:20.903 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:20.906 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:21.850 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:22.094 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-02-06T22:50:22.279 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-02-06T22:50:22.357 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-02-06T22:50:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-02-06T22:50:22.723 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/36 2021-02-06T22:50:22.844 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-02-06T22:50:22.911 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/36 2021-02-06T22:50:22.976 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-02-06T22:50:23.106 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/36 2021-02-06T22:50:23.122 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-02-06T22:50:23.261 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/36 2021-02-06T22:50:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-02-06T22:50:23.435 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 5/36 2021-02-06T22:50:23.485 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-02-06T22:50:23.548 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/36 2021-02-06T22:50:23.698 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/36 2021-02-06T22:50:23.717 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-02-06T22:50:23.905 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/36 2021-02-06T22:50:24.000 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-02-06T22:50:24.017 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/36 2021-02-06T22:50:24.156 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-02-06T22:50:24.214 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/36 2021-02-06T22:50:24.353 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-02-06T22:50:24.449 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 11/36 2021-02-06T22:50:24.559 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-02-06T22:50:24.581 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 12/36 2021-02-06T22:50:24.761 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 13/36 2021-02-06T22:50:24.859 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 15/36 2021-02-06T22:50:25.014 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 14/36 2021-02-06T22:50:25.061 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-02-06T22:50:25.287 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-urllib3-1.24.2-4.el8.noarch 15/36 2021-02-06T22:50:25.308 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-02-06T22:50:25.498 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-02-06T22:50:25.503 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 16/36 2021-02-06T22:50:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-02-06T22:50:25.781 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 17/36 2021-02-06T22:50:25.899 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-02-06T22:50:25.980 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 18/36 2021-02-06T22:50:26.186 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 19/36 2021-02-06T22:50:26.295 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-02-06T22:50:26.375 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 20/36 2021-02-06T22:50:26.563 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2021-02-06T22:50:26.744 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 21/36 2021-02-06T22:50:26.751 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-02-06T22:50:26.890 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-02-06T22:50:26.982 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 22/36 2021-02-06T22:50:27.048 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-02-06T22:50:27.118 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 23/36 2021-02-06T22:50:27.306 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/36 2021-02-06T22:50:27.307 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-02-06T22:50:27.475 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 25/36 2021-02-06T22:50:27.550 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-02-06T22:50:27.722 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-portend-2.6-1.el8.noarch 26/36 2021-02-06T22:50:27.761 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-02-06T22:50:27.915 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 27/36 2021-02-06T22:50:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-02-06T22:50:28.128 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/36 2021-02-06T22:50:28.430 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-02-06T22:50:28.614 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/36 2021-02-06T22:50:28.822 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.n 31/36 2021-02-06T22:50:28.908 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 30/36 2021-02-06T22:50:29.020 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 32/36 2021-02-06T22:50:29.424 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.n 31/36 2021-02-06T22:50:29.907 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 32/36 2021-02-06T22:50:30.495 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 32/36 2021-02-06T22:50:30.728 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 33/36 2021-02-06T22:50:31.147 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 33/36 2021-02-06T22:50:31.328 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 34/36 2021-02-06T22:50:31.483 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 32/36 2021-02-06T22:50:31.541 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 34/36 2021-02-06T22:50:31.737 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 35/36 2021-02-06T22:50:31.756 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 35/36 2021-02-06T22:50:31.812 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 33/36 2021-02-06T22:50:31.860 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 36/36 2021-02-06T22:50:32.203 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 36/36 2021-02-06T22:50:32.203 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/36 2021-02-06T22:50:32.203 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 2/36 2021-02-06T22:50:32.204 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/36 2021-02-06T22:50:32.204 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/36 2021-02-06T22:50:32.204 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/36 2021-02-06T22:50:32.204 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.n 6/36 2021-02-06T22:50:32.204 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-02-06T22:50:32.205 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2021-02-06T22:50:32.205 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-02-06T22:50:32.205 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-02-06T22:50:32.205 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-02-06T22:50:32.205 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-02-06T22:50:32.206 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-02-06T22:50:32.206 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-02-06T22:50:32.206 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-02-06T22:50:32.206 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-02-06T22:50:32.207 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 17/36 2021-02-06T22:50:32.207 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-02-06T22:50:32.207 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-02-06T22:50:32.207 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-02-06T22:50:32.207 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-02-06T22:50:32.208 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-02-06T22:50:32.208 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-02-06T22:50:32.208 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-02-06T22:50:32.208 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-02-06T22:50:32.208 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-02-06T22:50:32.209 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-02-06T22:50:32.209 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-02-06T22:50:32.209 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-02-06T22:50:32.209 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-02-06T22:50:32.209 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-02-06T22:50:32.210 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-02-06T22:50:32.210 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-02-06T22:50:32.210 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-02-06T22:50:32.210 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-02-06T22:50:32.259 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 33/36 2021-02-06T22:50:32.412 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 34/36 2021-02-06T22:50:32.638 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 34/36 2021-02-06T22:50:32.809 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 35/36 2021-02-06T22:50:32.828 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 35/36 2021-02-06T22:50:32.894 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-02-06T22:50:32.895 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:32.895 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:32.895 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:32.895 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:32.896 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:32.896 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:32.896 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:32.896 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:32.897 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-06T22:50:32.897 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-06T22:50:32.897 INFO:teuthology.orchestra.run.smithi106.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-06T22:50:32.898 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-06T22:50:32.898 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-06T22:50:32.898 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-06T22:50:32.898 INFO:teuthology.orchestra.run.smithi106.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-06T22:50:32.899 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-06T22:50:32.899 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-06T22:50:32.899 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-06T22:50:32.899 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-06T22:50:32.900 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-06T22:50:32.900 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-06T22:50:32.900 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-06T22:50:32.900 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-06T22:50:32.901 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-2.6-1.el8.noarch 2021-02-06T22:50:32.901 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-06T22:50:32.901 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-06T22:50:32.901 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-06T22:50:32.901 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-06T22:50:32.902 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-06T22:50:32.902 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-06T22:50:32.902 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-06T22:50:32.902 INFO:teuthology.orchestra.run.smithi106.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-06T22:50:32.903 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-06T22:50:32.903 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-06T22:50:32.903 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-06T22:50:32.903 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-06T22:50:32.903 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-06T22:50:32.904 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-06T22:50:32.904 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:32.904 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:32.925 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 36/36 2021-02-06T22:50:33.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-base 2021-02-06T22:50:33.327 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 36/36 2021-02-06T22:50:33.327 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/36 2021-02-06T22:50:33.328 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 2/36 2021-02-06T22:50:33.328 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/36 2021-02-06T22:50:33.328 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 4/36 2021-02-06T22:50:33.329 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 5/36 2021-02-06T22:50:33.329 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.n 6/36 2021-02-06T22:50:33.330 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/36 2021-02-06T22:50:33.330 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 8/36 2021-02-06T22:50:33.330 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/36 2021-02-06T22:50:33.330 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/36 2021-02-06T22:50:33.331 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 11/36 2021-02-06T22:50:33.331 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 12/36 2021-02-06T22:50:33.331 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 13/36 2021-02-06T22:50:33.331 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 14/36 2021-02-06T22:50:33.332 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 15/36 2021-02-06T22:50:33.332 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 16/36 2021-02-06T22:50:33.332 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-urllib3-1.24.2-4.el8.noarch 17/36 2021-02-06T22:50:33.332 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/36 2021-02-06T22:50:33.332 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 19/36 2021-02-06T22:50:33.333 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 20/36 2021-02-06T22:50:33.333 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 21/36 2021-02-06T22:50:33.333 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 22/36 2021-02-06T22:50:33.333 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 23/36 2021-02-06T22:50:33.333 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 24/36 2021-02-06T22:50:33.334 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 25/36 2021-02-06T22:50:33.334 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 26/36 2021-02-06T22:50:33.334 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 27/36 2021-02-06T22:50:33.336 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-portend-2.6-1.el8.noarch 28/36 2021-02-06T22:50:33.336 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 29/36 2021-02-06T22:50:33.336 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 30/36 2021-02-06T22:50:33.336 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 31/36 2021-02-06T22:50:33.336 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 32/36 2021-02-06T22:50:33.337 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 33/36 2021-02-06T22:50:33.337 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 34/36 2021-02-06T22:50:33.337 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 35/36 2021-02-06T22:50:33.563 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:07 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:33.927 INFO:teuthology.orchestra.run.smithi106.stdout:Package ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:50:34.038 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:34.039 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:50:34.039 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:34.112 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install cephadm 2021-02-06T22:50:34.245 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 36/36 2021-02-06T22:50:34.245 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:34.245 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:34.246 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:34.246 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mds-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:34.246 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-modules-core-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mon-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-osd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-06T22:50:34.247 INFO:teuthology.orchestra.run.smithi051.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-06T22:50:34.248 INFO:teuthology.orchestra.run.smithi051.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-02-06T22:50:34.248 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-06T22:50:34.248 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-06T22:50:34.248 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-06T22:50:34.249 INFO:teuthology.orchestra.run.smithi051.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-06T22:50:34.249 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-06T22:50:34.249 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-06T22:50:34.249 INFO:teuthology.orchestra.run.smithi051.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-06T22:50:34.249 INFO:teuthology.orchestra.run.smithi051.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-06T22:50:34.250 INFO:teuthology.orchestra.run.smithi051.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-06T22:50:34.250 INFO:teuthology.orchestra.run.smithi051.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-06T22:50:34.250 INFO:teuthology.orchestra.run.smithi051.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-06T22:50:34.250 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-06T22:50:34.251 INFO:teuthology.orchestra.run.smithi051.stdout: python3-portend-2.6-1.el8.noarch 2021-02-06T22:50:34.251 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-02-06T22:50:34.251 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-06T22:50:34.251 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-02-06T22:50:34.251 INFO:teuthology.orchestra.run.smithi051.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-06T22:50:34.252 INFO:teuthology.orchestra.run.smithi051.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-06T22:50:34.252 INFO:teuthology.orchestra.run.smithi051.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-06T22:50:34.252 INFO:teuthology.orchestra.run.smithi051.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-06T22:50:34.252 INFO:teuthology.orchestra.run.smithi051.stdout: python3-urllib3-1.24.2-4.el8.noarch 2021-02-06T22:50:34.253 INFO:teuthology.orchestra.run.smithi051.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-06T22:50:34.253 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-06T22:50:34.253 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-06T22:50:34.253 INFO:teuthology.orchestra.run.smithi051.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-06T22:50:34.253 INFO:teuthology.orchestra.run.smithi051.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-06T22:50:34.254 INFO:teuthology.orchestra.run.smithi051.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-06T22:50:34.254 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:34.255 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:34.478 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-base 2021-02-06T22:50:34.562 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:08 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:34.969 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:08 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:35.055 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:35.056 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:35.056 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:35.056 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:35.057 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:35.057 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 67 k 2021-02-06T22:50:35.057 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:35.057 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:35.057 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:35.058 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:50:35.058 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:35.058 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 67 k 2021-02-06T22:50:35.058 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 272 k 2021-02-06T22:50:35.058 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:35.203 INFO:teuthology.orchestra.run.smithi106.stdout:cephadm-16.1.0-114.g39ebd5ec.el8.noarch.rpm 460 kB/s | 67 kB 00:00 2021-02-06T22:50:35.204 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:35.204 INFO:teuthology.orchestra.run.smithi106.stdout:Total 456 kB/s | 67 kB 00:00 2021-02-06T22:50:35.204 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:35.212 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:35.212 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:35.214 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:35.216 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:35.290 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:35.637 INFO:teuthology.orchestra.run.smithi051.stdout:Package ceph-base-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:50:35.756 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:35.758 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:50:35.758 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:35.903 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install cephadm 2021-02-06T22:50:36.388 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:10 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:36.815 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:36.850 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:36.851 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:36.851 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:50:36.851 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:36.851 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:36.852 INFO:teuthology.orchestra.run.smithi051.stdout: cephadm noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 67 k 2021-02-06T22:50:36.852 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:36.852 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:36.852 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:36.853 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:50:36.853 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:36.853 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 67 k 2021-02-06T22:50:36.853 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 272 k 2021-02-06T22:50:36.853 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:36.966 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:37.132 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:37.178 INFO:teuthology.orchestra.run.smithi051.stdout:cephadm-16.1.0-114.g39ebd5ec.el8.noarch.rpm 206 kB/s | 67 kB 00:00 2021-02-06T22:50:37.179 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:37.179 INFO:teuthology.orchestra.run.smithi051.stdout:Total 205 kB/s | 67 kB 00:00 2021-02-06T22:50:37.180 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:37.188 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:37.188 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:37.191 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:37.193 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:37.239 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:37.450 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:37.451 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:37.451 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:37.451 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:37.451 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:37.452 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:37.609 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-immutable-object-cache 2021-02-06T22:50:38.074 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:12 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:38.522 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:38.522 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:38.523 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2021-02-06T22:50:38.523 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:38.523 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:38.523 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 161 k 2021-02-06T22:50:38.524 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:38.524 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:38.524 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:38.524 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:50:38.525 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:38.525 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 161 k 2021-02-06T22:50:38.525 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 471 k 2021-02-06T22:50:38.525 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:38.698 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-immutable-object-cache-16.1.0-114.g39ebd5e 919 kB/s | 161 kB 00:00 2021-02-06T22:50:38.699 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:38.699 INFO:teuthology.orchestra.run.smithi106.stdout:Total 912 kB/s | 161 kB 00:00 2021-02-06T22:50:38.700 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:38.712 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:38.712 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:38.759 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:38.762 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:38.870 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:38.935 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:39.069 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:39.099 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:39.277 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:39.438 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:39.598 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/1 2021-02-06T22:50:39.599 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:39.599 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:39.599 INFO:teuthology.orchestra.run.smithi051.stdout: cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:39.599 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:39.600 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:39.682 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:39.683 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:39.683 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:39.684 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:39.766 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-immutable-object-cache 2021-02-06T22:50:39.848 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr 2021-02-06T22:50:40.261 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:14 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:40.305 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:14 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:40.677 INFO:teuthology.orchestra.run.smithi106.stdout:Package ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:50:40.744 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:40.745 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:40.746 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2021-02-06T22:50:40.746 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:40.746 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:40.746 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-immutable-object-cache x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 161 k 2021-02-06T22:50:40.746 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:40.747 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:40.747 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:40.747 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:50:40.747 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:40.747 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 161 k 2021-02-06T22:50:40.748 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 471 k 2021-02-06T22:50:40.748 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:40.788 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:40.789 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:50:40.789 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:40.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-dashboard 2021-02-06T22:50:41.277 INFO:teuthology.orchestra.run.smithi051.stdout:ceph-immutable-object-cache-16.1.0-114.g39ebd5e 304 kB/s | 161 kB 00:00 2021-02-06T22:50:41.277 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:41.278 INFO:teuthology.orchestra.run.smithi051.stdout:Total 303 kB/s | 161 kB 00:00 2021-02-06T22:50:41.278 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:41.293 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:41.294 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:41.307 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:15 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:41.347 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:41.350 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:41.465 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:41.674 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:41.763 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:41.764 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:41.764 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:41.764 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:41.764 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 2.6 M 2021-02-06T22:50:41.765 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:50:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 24 k 2021-02-06T22:50:41.765 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 8.8 k 2021-02-06T22:50:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-06T22:50:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-06T22:50:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-06T22:50:41.766 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:41.767 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:41.767 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:50:41.767 INFO:teuthology.orchestra.run.smithi106.stdout:Install 6 Packages 2021-02-06T22:50:41.767 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:41.768 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 2.9 M 2021-02-06T22:50:41.768 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 15 M 2021-02-06T22:50:41.769 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:41.960 INFO:teuthology.orchestra.run.smithi106.stdout:(1/6): ceph-prometheus-alerts-16.1.0-114.g39ebd 46 kB/s | 8.8 kB 00:00 2021-02-06T22:50:41.973 INFO:teuthology.orchestra.run.smithi106.stdout:(2/6): ceph-grafana-dashboards-16.1.0-114.g39eb 116 kB/s | 24 kB 00:00 2021-02-06T22:50:41.991 INFO:teuthology.orchestra.run.smithi106.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2021-02-06T22:50:42.023 INFO:teuthology.orchestra.run.smithi106.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 681 kB/s | 34 kB 00:00 2021-02-06T22:50:42.026 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:42.087 INFO:teuthology.orchestra.run.smithi106.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.0 MB/s | 196 kB 00:00 2021-02-06T22:50:42.374 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.e 1/1 2021-02-06T22:50:42.374 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:42.375 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:42.375 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-immutable-object-cache-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:50:42.375 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:42.375 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:42.500 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr 2021-02-06T22:50:42.574 INFO:teuthology.orchestra.run.smithi106.stdout:(6/6): ceph-mgr-dashboard-16.1.0-114.g39ebd5ec. 3.3 MB/s | 2.6 MB 00:00 2021-02-06T22:50:42.576 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:42.577 INFO:teuthology.orchestra.run.smithi106.stdout:Total 3.6 MB/s | 2.9 MB 00:00 2021-02-06T22:50:42.578 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:42.587 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:42.588 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:42.700 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:42.702 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:42.981 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:42.984 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:16 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:43.216 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-02-06T22:50:43.375 INFO:teuthology.orchestra.run.smithi051.stdout:Package ceph-mgr-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:50:43.477 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-02-06T22:50:43.495 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:43.496 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:50:43.496 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:43.568 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-dashboard 2021-02-06T22:50:43.678 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-02-06T22:50:43.816 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.no 4/6 2021-02-06T22:50:44.051 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:18 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:44.550 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:44.551 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:44.551 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:50:44.551 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:44.552 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:44.552 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-dashboard noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 2.6 M 2021-02-06T22:50:44.552 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:50:44.552 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-grafana-dashboards noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 24 k 2021-02-06T22:50:44.552 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-prometheus-alerts noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 8.8 k 2021-02-06T22:50:44.553 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-02-06T22:50:44.553 INFO:teuthology.orchestra.run.smithi051.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-06T22:50:44.553 INFO:teuthology.orchestra.run.smithi051.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-06T22:50:44.553 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:44.554 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:44.554 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:50:44.554 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2021-02-06T22:50:44.554 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:44.555 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 2.9 M 2021-02-06T22:50:44.555 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 15 M 2021-02-06T22:50:44.555 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:44.664 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): ceph-prometheus-alerts-16.1.0-114.g39ebd 80 kB/s | 8.8 kB 00:00 2021-02-06T22:50:44.678 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): ceph-grafana-dashboards-16.1.0-114.g39eb 194 kB/s | 24 kB 00:00 2021-02-06T22:50:44.696 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.3 MB/s | 43 kB 00:00 2021-02-06T22:50:44.728 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 670 kB/s | 34 kB 00:00 2021-02-06T22:50:44.777 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 2.4 MB/s | 196 kB 00:00 2021-02-06T22:50:44.840 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.n 5/6 2021-02-06T22:50:44.860 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): ceph-mgr-dashboard-16.1.0-114.g39ebd5ec. 8.6 MB/s | 2.6 MB 00:00 2021-02-06T22:50:44.862 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:44.863 INFO:teuthology.orchestra.run.smithi051.stdout:Total 9.5 MB/s | 2.9 MB 00:00 2021-02-06T22:50:44.864 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:44.874 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:44.874 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:44.984 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:44.986 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:45.093 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:50:45.279 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:50:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.n 1/6 2021-02-06T22:50:45.324 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 2/6 2021-02-06T22:50:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.no 3/6 2021-02-06T22:50:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-02-06T22:50:45.325 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-02-06T22:50:45.508 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-02-06T22:50:45.769 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-02-06T22:50:46.542 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-02-06T22:50:46.974 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-02-06T22:50:46.974 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:46.974 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:46.975 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:46.975 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:46.975 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:46.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-06T22:50:46.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-06T22:50:46.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-06T22:50:46.976 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:46.976 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:47.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-diskprediction-local 2021-02-06T22:50:47.499 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:21 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:47.792 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.no 4/6 2021-02-06T22:50:47.938 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:47.940 INFO:teuthology.orchestra.run.smithi106.stdout:===================================================================================================== 2021-02-06T22:50:47.940 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:47.940 INFO:teuthology.orchestra.run.smithi106.stdout:===================================================================================================== 2021-02-06T22:50:47.940 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:47.941 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 8.6 M 2021-02-06T22:50:47.941 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:50:47.941 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-06T22:50:47.941 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-06T22:50:47.941 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-06T22:50:47.942 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-06T22:50:47.942 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-06T22:50:47.942 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-06T22:50:47.942 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-06T22:50:47.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:47.943 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:47.943 INFO:teuthology.orchestra.run.smithi106.stdout:===================================================================================================== 2021-02-06T22:50:47.943 INFO:teuthology.orchestra.run.smithi106.stdout:Install 8 Packages 2021-02-06T22:50:47.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:47.944 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 36 M 2021-02-06T22:50:47.944 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 194 M 2021-02-06T22:50:47.945 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:48.033 INFO:teuthology.orchestra.run.smithi106.stdout:(1/8): openblas-0.3.3-5.el8.x86_64.rpm 47 MB/s | 4.3 MB 00:00 2021-02-06T22:50:48.087 INFO:teuthology.orchestra.run.smithi106.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 70 MB/s | 3.7 MB 00:00 2021-02-06T22:50:48.092 INFO:teuthology.orchestra.run.smithi106.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 44 MB/s | 225 kB 00:00 2021-02-06T22:50:48.159 INFO:teuthology.orchestra.run.smithi106.stdout:(4/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 20 MB/s | 4.3 MB 00:00 2021-02-06T22:50:48.192 INFO:teuthology.orchestra.run.smithi106.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2021-02-06T22:50:48.209 INFO:teuthology.orchestra.run.smithi106.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 9.8 MB/s | 169 kB 00:00 2021-02-06T22:50:48.362 INFO:teuthology.orchestra.run.smithi106.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.3.0+56 54 MB/s | 15 MB 00:00 2021-02-06T22:50:48.701 INFO:teuthology.orchestra.run.smithi106.stdout:(8/8): ceph-mgr-diskprediction-local-16.1.0-114 11 MB/s | 8.6 MB 00:00 2021-02-06T22:50:48.704 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:48.705 INFO:teuthology.orchestra.run.smithi106.stdout:Total 48 MB/s | 36 MB 00:00 2021-02-06T22:50:48.713 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:48.733 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:48.733 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:48.770 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.n 5/6 2021-02-06T22:50:49.009 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:50:49.023 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:49.026 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:49.283 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:50:49.283 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.n 1/6 2021-02-06T22:50:49.284 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 2/6 2021-02-06T22:50:49.284 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.no 3/6 2021-02-06T22:50:49.284 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-02-06T22:50:49.284 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-02-06T22:50:49.548 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:49.640 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-02-06T22:50:49.640 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:49.641 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:50:49.641 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-grafana-dashboards-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:49.641 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-dashboard-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:49.641 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-prometheus-alerts-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:49.642 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-06T22:50:49.642 INFO:teuthology.orchestra.run.smithi051.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-06T22:50:49.642 INFO:teuthology.orchestra.run.smithi051.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-06T22:50:49.642 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:49.642 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:50:49.708 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-diskprediction-local 2021-02-06T22:50:49.767 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-06T22:50:49.887 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-06T22:50:50.017 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-06T22:50:50.190 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:24 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-06T22:50:50.657 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:50:50.658 INFO:teuthology.orchestra.run.smithi051.stdout:===================================================================================================== 2021-02-06T22:50:50.659 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:50:50.659 INFO:teuthology.orchestra.run.smithi051.stdout:===================================================================================================== 2021-02-06T22:50:50.659 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:50:50.659 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-diskprediction-local noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 8.6 M 2021-02-06T22:50:50.660 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:50:50.660 INFO:teuthology.orchestra.run.smithi051.stdout: libgfortran x86_64 8.3.1-5.1.el8 CentOS-Base 639 k 2021-02-06T22:50:50.660 INFO:teuthology.orchestra.run.smithi051.stdout: libquadmath x86_64 8.3.1-5.1.el8 CentOS-Base 169 k 2021-02-06T22:50:50.660 INFO:teuthology.orchestra.run.smithi051.stdout: openblas x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-06T22:50:50.660 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-threads x86_64 0.3.3-5.el8 CentOS-AppStream 4.3 M 2021-02-06T22:50:50.661 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy x86_64 1:1.14.3-9.el8 CentOS-AppStream 3.7 M 2021-02-06T22:50:50.661 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 CentOS-AppStream 225 k 2021-02-06T22:50:50.661 INFO:teuthology.orchestra.run.smithi051.stdout: python3-scipy x86_64 1.0.0-20.module_el8.3.0+562+e162826a CentOS-AppStream 15 M 2021-02-06T22:50:50.661 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:50.661 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:50:50.662 INFO:teuthology.orchestra.run.smithi051.stdout:===================================================================================================== 2021-02-06T22:50:50.662 INFO:teuthology.orchestra.run.smithi051.stdout:Install 8 Packages 2021-02-06T22:50:50.662 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:50:50.663 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 36 M 2021-02-06T22:50:50.663 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 194 M 2021-02-06T22:50:50.663 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:50:50.692 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:50:50.749 INFO:teuthology.orchestra.run.smithi051.stdout:(1/8): openblas-0.3.3-5.el8.x86_64.rpm 49 MB/s | 4.3 MB 00:00 2021-02-06T22:50:50.807 INFO:teuthology.orchestra.run.smithi051.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 71 MB/s | 3.7 MB 00:00 2021-02-06T22:50:50.813 INFO:teuthology.orchestra.run.smithi051.stdout:(3/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 39 MB/s | 225 kB 00:00 2021-02-06T22:50:50.901 INFO:teuthology.orchestra.run.smithi051.stdout:(4/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 18 MB/s | 4.3 MB 00:00 2021-02-06T22:50:50.930 INFO:teuthology.orchestra.run.smithi051.stdout:(5/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 22 MB/s | 639 kB 00:00 2021-02-06T22:50:50.944 INFO:teuthology.orchestra.run.smithi051.stdout:(6/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 12 MB/s | 169 kB 00:00 2021-02-06T22:50:51.081 INFO:teuthology.orchestra.run.smithi051.stdout:(7/8): python3-scipy-1.0.0-20.module_el8.3.0+56 54 MB/s | 15 MB 00:00 2021-02-06T22:50:51.222 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:50:51.366 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-06T22:50:52.080 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-06T22:50:52.456 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-02-06T22:50:52.708 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-06T22:50:53.561 INFO:teuthology.orchestra.run.smithi051.stdout:(8/8): ceph-mgr-diskprediction-local-16.1.0-114 3.0 MB/s | 8.6 MB 00:02 2021-02-06T22:50:53.564 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:53.565 INFO:teuthology.orchestra.run.smithi051.stdout:Total 13 MB/s | 36 MB 00:02 2021-02-06T22:50:53.575 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:50:53.598 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:50:53.598 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:50:53.907 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:50:53.909 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:50:54.448 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:50:54.597 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-06T22:50:54.646 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-06T22:50:54.760 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-06T22:50:54.863 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-06T22:50:55.430 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-06T22:50:55.547 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : openblas-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:50:55.961 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-02-06T22:50:56.082 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:50:56.183 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 8/8 2021-02-06T22:50:56.246 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-06T22:50:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 8/8 2021-02-06T22:50:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 1/8 2021-02-06T22:50:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-02-06T22:50:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:50:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-02-06T22:50:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-02-06T22:50:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-02-06T22:50:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-02-06T22:50:56.730 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-02-06T22:50:56.731 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:56.731 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:50:56.731 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:50:56.731 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-06T22:50:56.732 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-06T22:50:56.732 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-06T22:50:56.732 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-06T22:50:56.732 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-06T22:50:56.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-06T22:50:56.733 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-06T22:50:56.733 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:56.733 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:50:56.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-rook 2021-02-06T22:50:56.999 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 4/8 2021-02-06T22:50:57.295 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:31 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:50:57.316 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-02-06T22:50:57.530 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-06T22:50:57.764 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:50:57.766 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2021-02-06T22:50:57.766 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:50:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2021-02-06T22:50:57.767 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:50:57.767 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 27 k 2021-02-06T22:50:57.768 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:50:57.768 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-06T22:50:57.769 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-06T22:50:57.769 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-06T22:50:57.770 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-06T22:50:57.770 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-06T22:50:57.770 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-06T22:50:57.771 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-06T22:50:57.771 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-06T22:50:57.772 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-06T22:50:57.772 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-06T22:50:57.772 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-06T22:50:57.773 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-06T22:50:57.773 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:57.773 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:50:57.774 INFO:teuthology.orchestra.run.smithi106.stdout:======================================================================================= 2021-02-06T22:50:57.774 INFO:teuthology.orchestra.run.smithi106.stdout:Install 13 Packages 2021-02-06T22:50:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:50:57.776 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 1.9 M 2021-02-06T22:50:57.776 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 24 M 2021-02-06T22:50:57.776 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:50:57.801 INFO:teuthology.orchestra.run.smithi106.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 841 kB/s | 27 kB 00:00 2021-02-06T22:50:57.803 INFO:teuthology.orchestra.run.smithi106.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 49 MB/s | 126 kB 00:00 2021-02-06T22:50:57.804 INFO:teuthology.orchestra.run.smithi106.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 575 kB/s | 20 kB 00:00 2021-02-06T22:50:57.806 INFO:teuthology.orchestra.run.smithi106.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 36 MB/s | 110 kB 00:00 2021-02-06T22:50:57.807 INFO:teuthology.orchestra.run.smithi106.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 43 MB/s | 155 kB 00:00 2021-02-06T22:50:57.808 INFO:teuthology.orchestra.run.smithi106.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 32 MB/s | 43 kB 00:00 2021-02-06T22:50:57.857 INFO:teuthology.orchestra.run.smithi106.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 334 kB/s | 16 kB 00:00 2021-02-06T22:50:57.869 INFO:teuthology.orchestra.run.smithi106.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 533 kB/s | 33 kB 00:00 2021-02-06T22:50:57.893 INFO:teuthology.orchestra.run.smithi106.stdout:(9/13): ceph-mgr-rook-16.1.0-114.g39ebd5ec.el8. 221 kB/s | 27 kB 00:00 2021-02-06T22:50:57.905 INFO:teuthology.orchestra.run.smithi106.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.7 MB/s | 81 kB 00:00 2021-02-06T22:50:57.922 INFO:teuthology.orchestra.run.smithi106.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 3.5 MB/s | 61 kB 00:00 2021-02-06T22:50:57.971 INFO:teuthology.orchestra.run.smithi106.stdout:(12/13): python3-rsa-3.4.2-16.el8.noarch.rpm 946 kB/s | 73 kB 00:00 2021-02-06T22:50:57.988 INFO:teuthology.orchestra.run.smithi106.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 9.9 MB/s | 1.2 MB 00:00 2021-02-06T22:50:57.990 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:50:57.990 INFO:teuthology.orchestra.run.smithi106.stdout:Total 8.6 MB/s | 1.9 MB 00:00 2021-02-06T22:50:57.995 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:50:58.009 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:50:58.010 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:50:58.078 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:50:58.080 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:50:58.590 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:50:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-02-06T22:50:59.072 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-02-06T22:50:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-02-06T22:50:59.514 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-02-06T22:50:59.614 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-06T22:50:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-02-06T22:50:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-02-06T22:51:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-02-06T22:51:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-02-06T22:51:01.097 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 7/8 2021-02-06T22:51:01.321 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 8/8 2021-02-06T22:51:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-02-06T22:51:01.587 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 8/8 2021-02-06T22:51:01.588 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec 1/8 2021-02-06T22:51:01.588 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 2/8 2021-02-06T22:51:01.588 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-06T22:51:01.588 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-02-06T22:51:01.589 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 5/8 2021-02-06T22:51:01.589 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x 6/8 2021-02-06T22:51:01.589 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 7/8 2021-02-06T22:51:01.887 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 8/8 2021-02-06T22:51:01.888 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:01.888 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:01.888 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-diskprediction-local-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:51:01.888 INFO:teuthology.orchestra.run.smithi051.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-06T22:51:01.889 INFO:teuthology.orchestra.run.smithi051.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-06T22:51:01.889 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-06T22:51:01.889 INFO:teuthology.orchestra.run.smithi051.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-06T22:51:01.889 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-06T22:51:01.890 INFO:teuthology.orchestra.run.smithi051.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-06T22:51:01.890 INFO:teuthology.orchestra.run.smithi051.stdout: python3-scipy-1.0.0-20.module_el8.3.0+562+e162826a.x86_64 2021-02-06T22:51:01.890 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:01.890 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-02-06T22:51:01.968 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-rook 2021-02-06T22:51:02.064 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-02-06T22:51:02.290 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-02-06T22:51:02.449 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 13/13 2021-02-06T22:51:02.451 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:36 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 13/13 2021-02-06T22:51:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 1/13 2021-02-06T22:51:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-02-06T22:51:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-02-06T22:51:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-02-06T22:51:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-02-06T22:51:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-02-06T22:51:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-02-06T22:51:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-02-06T22:51:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-02-06T22:51:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-02-06T22:51:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-02-06T22:51:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-02-06T22:51:02.933 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:02.935 INFO:teuthology.orchestra.run.smithi051.stdout:======================================================================================= 2021-02-06T22:51:02.935 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:51:02.935 INFO:teuthology.orchestra.run.smithi051.stdout:======================================================================================= 2021-02-06T22:51:02.935 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:02.936 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-rook noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 27 k 2021-02-06T22:51:02.936 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:51:02.936 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-06T22:51:02.936 INFO:teuthology.orchestra.run.smithi051.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-06T22:51:02.937 INFO:teuthology.orchestra.run.smithi051.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-06T22:51:02.937 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-02-06T22:51:02.937 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-02-06T22:51:02.937 INFO:teuthology.orchestra.run.smithi051.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-06T22:51:02.937 INFO:teuthology.orchestra.run.smithi051.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-02-06T22:51:02.938 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-02-06T22:51:02.938 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-02-06T22:51:02.938 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-02-06T22:51:02.938 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-06T22:51:02.939 INFO:teuthology.orchestra.run.smithi051.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-06T22:51:02.939 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:02.939 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:02.939 INFO:teuthology.orchestra.run.smithi051.stdout:======================================================================================= 2021-02-06T22:51:02.940 INFO:teuthology.orchestra.run.smithi051.stdout:Install 13 Packages 2021-02-06T22:51:02.940 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:02.941 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 1.9 M 2021-02-06T22:51:02.941 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 24 M 2021-02-06T22:51:02.941 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:03.012 INFO:teuthology.orchestra.run.smithi051.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2021-02-06T22:51:03.105 INFO:teuthology.orchestra.run.smithi051.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.3 MB/s | 126 kB 00:00 2021-02-06T22:51:03.168 INFO:teuthology.orchestra.run.smithi051.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 87 kB/s | 20 kB 00:00 2021-02-06T22:51:03.169 INFO:teuthology.orchestra.run.smithi051.stdout:(4/13): ceph-mgr-rook-16.1.0-114.g39ebd5ec.el8. 119 kB/s | 27 kB 00:00 2021-02-06T22:51:03.242 INFO:teuthology.orchestra.run.smithi051.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 804 kB/s | 110 kB 00:00 2021-02-06T22:51:03.265 INFO:teuthology.orchestra.run.smithi051.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.6 MB/s | 155 kB 00:00 2021-02-06T22:51:03.274 INFO:teuthology.orchestra.run.smithi051.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 408 kB/s | 43 kB 00:00 2021-02-06T22:51:03.303 INFO:teuthology.orchestra.run.smithi051.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 600 kB/s | 33 kB 00:00 2021-02-06T22:51:03.325 INFO:teuthology.orchestra.run.smithi051.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 276 kB/s | 16 kB 00:00 2021-02-06T22:51:03.371 INFO:teuthology.orchestra.run.smithi051.stdout:(10/13): python3-rsa-3.4.2-16.el8.noarch.rpm 1.6 MB/s | 73 kB 00:00 2021-02-06T22:51:03.468 INFO:teuthology.orchestra.run.smithi051.stdout:(11/13): python3-google-auth-1.1.1-10.el8.noarc 420 kB/s | 81 kB 00:00 2021-02-06T22:51:03.540 INFO:teuthology.orchestra.run.smithi051.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 362 kB/s | 61 kB 00:00 2021-02-06T22:51:03.546 INFO:teuthology.orchestra.run.smithi051.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.8 MB/s | 1.2 MB 00:00 2021-02-06T22:51:03.550 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:03.550 INFO:teuthology.orchestra.run.smithi051.stdout:Total 3.1 MB/s | 1.9 MB 00:00 2021-02-06T22:51:03.557 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:03.576 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:03.576 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:03.657 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:03.659 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:03.780 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-02-06T22:51:03.780 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:03.780 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:03.780 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:51:03.781 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-06T22:51:03.781 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-06T22:51:03.781 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-06T22:51:03.781 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-06T22:51:03.782 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-06T22:51:03.782 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-06T22:51:03.782 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-06T22:51:03.783 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-06T22:51:03.783 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-06T22:51:03.783 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-06T22:51:03.783 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-06T22:51:03.783 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-06T22:51:03.784 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:03.784 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:03.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-mgr-cephadm 2021-02-06T22:51:04.300 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:38 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:04.441 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:04.679 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-02-06T22:51:04.753 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:04.754 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:04.755 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:51:04.755 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:04.755 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:04.755 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 75 k 2021-02-06T22:51:04.755 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:51:04.756 INFO:teuthology.orchestra.run.smithi106.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-06T22:51:04.756 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-06T22:51:04.756 INFO:teuthology.orchestra.run.smithi106.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-06T22:51:04.756 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-06T22:51:04.757 INFO:teuthology.orchestra.run.smithi106.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-06T22:51:04.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:04.757 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:04.757 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:04.757 INFO:teuthology.orchestra.run.smithi106.stdout:Install 6 Packages 2021-02-06T22:51:04.758 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:04.758 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 5.8 M 2021-02-06T22:51:04.758 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 24 M 2021-02-06T22:51:04.759 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:04.805 INFO:teuthology.orchestra.run.smithi106.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 11 MB/s | 538 kB 00:00 2021-02-06T22:51:04.850 INFO:teuthology.orchestra.run.smithi106.stdout:(2/6): python3-babel-2.5.1-5.el8.noarch.rpm 52 MB/s | 4.8 MB 00:00 2021-02-06T22:51:04.854 INFO:teuthology.orchestra.run.smithi106.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 432 kB/s | 21 kB 00:00 2021-02-06T22:51:04.872 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-02-06T22:51:04.886 INFO:teuthology.orchestra.run.smithi106.stdout:(4/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.4 MB/s | 48 kB 00:00 2021-02-06T22:51:04.905 INFO:teuthology.orchestra.run.smithi106.stdout:(5/6): ceph-mgr-cephadm-16.1.0-114.g39ebd5ec.el 507 kB/s | 75 kB 00:00 2021-02-06T22:51:04.948 INFO:teuthology.orchestra.run.smithi106.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.6 MB/s | 355 kB 00:00 2021-02-06T22:51:04.949 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:04.950 INFO:teuthology.orchestra.run.smithi106.stdout:Total 30 MB/s | 5.8 MB 00:00 2021-02-06T22:51:04.952 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:04.962 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:04.962 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:05.038 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:05.040 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:05.101 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 3/13 2021-02-06T22:51:05.327 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:05.337 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-02-06T22:51:05.546 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-02-06T22:51:05.617 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-02-06T22:51:05.792 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-02-06T22:51:05.886 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-02-06T22:51:06.082 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-02-06T22:51:06.288 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-02-06T22:51:06.841 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-02-06T22:51:07.256 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-02-06T22:51:07.406 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-02-06T22:51:07.477 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-02-06T22:51:07.661 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-02-06T22:51:07.664 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:51:07.828 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-02-06T22:51:07.899 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:51:07.899 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/6 2021-02-06T22:51:07.900 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-02-06T22:51:07.900 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-02-06T22:51:07.900 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-02-06T22:51:07.900 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-02-06T22:51:08.021 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-02-06T22:51:08.178 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 13/13 2021-02-06T22:51:08.220 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-02-06T22:51:08.220 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:08.220 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:08.220 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:51:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-06T22:51:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-06T22:51:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-06T22:51:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-06T22:51:08.221 INFO:teuthology.orchestra.run.smithi106.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-06T22:51:08.222 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:08.222 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:08.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-fuse 2021-02-06T22:51:08.475 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 13/13 2021-02-06T22:51:08.475 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 1/13 2021-02-06T22:51:08.476 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-02-06T22:51:08.476 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-02-06T22:51:08.476 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-02-06T22:51:08.476 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-02-06T22:51:08.476 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-02-06T22:51:08.477 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-02-06T22:51:08.477 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-02-06T22:51:08.477 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-02-06T22:51:08.477 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-02-06T22:51:08.477 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-02-06T22:51:08.478 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 12/13 2021-02-06T22:51:08.749 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:42 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:08.862 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-02-06T22:51:08.863 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:08.863 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:08.863 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-rook-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:51:08.863 INFO:teuthology.orchestra.run.smithi051.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-06T22:51:08.864 INFO:teuthology.orchestra.run.smithi051.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-06T22:51:08.864 INFO:teuthology.orchestra.run.smithi051.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-06T22:51:08.864 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-06T22:51:08.864 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-06T22:51:08.864 INFO:teuthology.orchestra.run.smithi051.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-06T22:51:08.865 INFO:teuthology.orchestra.run.smithi051.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-06T22:51:08.865 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-06T22:51:08.865 INFO:teuthology.orchestra.run.smithi051.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-06T22:51:08.865 INFO:teuthology.orchestra.run.smithi051.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-06T22:51:08.865 INFO:teuthology.orchestra.run.smithi051.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-06T22:51:08.866 INFO:teuthology.orchestra.run.smithi051.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-06T22:51:08.866 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:08.866 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:08.933 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-mgr-cephadm 2021-02-06T22:51:09.269 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:09.269 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:09.270 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2021-02-06T22:51:09.270 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:09.270 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:09.270 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 875 k 2021-02-06T22:51:09.271 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2021-02-06T22:51:09.271 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-06T22:51:09.271 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-06T22:51:09.271 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:09.271 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:09.272 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:09.272 INFO:teuthology.orchestra.run.smithi106.stdout:Install 3 Packages 2021-02-06T22:51:09.272 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:09.273 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 979 k 2021-02-06T22:51:09.273 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 2.8 M 2021-02-06T22:51:09.273 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:09.409 INFO:teuthology.orchestra.run.smithi106.stdout:(1/3): fuse-common-3.2.1-12.el8.x86_64.rpm 154 kB/s | 21 kB 00:00 2021-02-06T22:51:09.419 INFO:teuthology.orchestra.run.smithi106.stdout:(2/3): fuse-2.9.7-12.el8.x86_64.rpm 559 kB/s | 82 kB 00:00 2021-02-06T22:51:09.420 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:43 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:09.512 INFO:teuthology.orchestra.run.smithi106.stdout:(3/3): ceph-fuse-16.1.0-114.g39ebd5ec.el8.x86_6 3.6 MB/s | 875 kB 00:00 2021-02-06T22:51:09.513 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:09.514 INFO:teuthology.orchestra.run.smithi106.stdout:Total 3.9 MB/s | 979 kB 00:00 2021-02-06T22:51:09.516 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:09.538 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:09.538 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:09.612 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:09.614 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:09.787 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:09.788 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2021-02-06T22:51:09.788 INFO:teuthology.orchestra.run.smithi106.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-06T22:51:09.788 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:09.889 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:09.891 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:09.891 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:51:09.891 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:09.891 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:09.892 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-cephadm noarch 2:16.1.0-114.g39ebd5ec.el8 ceph-noarch 75 k 2021-02-06T22:51:09.892 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:51:09.892 INFO:teuthology.orchestra.run.smithi051.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-06T22:51:09.892 INFO:teuthology.orchestra.run.smithi051.stdout: python3-babel noarch 2.5.1-5.el8 CentOS-AppStream 4.8 M 2021-02-06T22:51:09.892 INFO:teuthology.orchestra.run.smithi051.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-06T22:51:09.893 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 CentOS-AppStream 538 k 2021-02-06T22:51:09.893 INFO:teuthology.orchestra.run.smithi051.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-06T22:51:09.893 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:09.893 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:09.893 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:09.894 INFO:teuthology.orchestra.run.smithi051.stdout:Install 6 Packages 2021-02-06T22:51:09.894 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:09.894 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 5.8 M 2021-02-06T22:51:09.895 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 24 M 2021-02-06T22:51:09.895 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:10.011 INFO:teuthology.orchestra.run.smithi051.stdout:(1/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 4.5 MB/s | 538 kB 00:00 2021-02-06T22:51:10.042 INFO:teuthology.orchestra.run.smithi051.stdout:(2/6): ceph-mgr-cephadm-16.1.0-114.g39ebd5ec.el 508 kB/s | 75 kB 00:00 2021-02-06T22:51:10.055 INFO:teuthology.orchestra.run.smithi051.stdout:(3/6): python3-babel-2.5.1-5.el8.noarch.rpm 30 MB/s | 4.8 MB 00:00 2021-02-06T22:51:10.070 INFO:teuthology.orchestra.run.smithi051.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 357 kB/s | 21 kB 00:00 2021-02-06T22:51:10.133 INFO:teuthology.orchestra.run.smithi051.stdout:(5/6): python3-remoto-1.1.4-4.el8.noarch.rpm 615 kB/s | 48 kB 00:00 2021-02-06T22:51:10.159 INFO:teuthology.orchestra.run.smithi051.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 3.0 MB/s | 355 kB 00:00 2021-02-06T22:51:10.161 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:10.162 INFO:teuthology.orchestra.run.smithi051.stdout:Total 22 MB/s | 5.8 MB 00:00 2021-02-06T22:51:10.165 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:10.175 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:10.175 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:10.236 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-06T22:51:10.257 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:10.260 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:10.422 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/3 2021-02-06T22:51:10.548 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:10.778 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/3 2021-02-06T22:51:10.778 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/3 2021-02-06T22:51:10.779 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-06T22:51:10.811 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2021-02-06T22:51:11.051 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2021-02-06T22:51:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2021-02-06T22:51:11.118 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:11.119 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-02-06T22:51:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-06T22:51:11.119 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:11.120 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:11.303 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librados-devel 2021-02-06T22:51:11.765 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:45 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:12.029 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 3/6 2021-02-06T22:51:12.252 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:12.253 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:12.253 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2021-02-06T22:51:12.253 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:12.253 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:12.254 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 131 k 2021-02-06T22:51:12.254 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:12.254 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:12.255 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:12.255 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:51:12.255 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:12.255 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 131 k 2021-02-06T22:51:12.255 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 431 k 2021-02-06T22:51:12.256 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:12.394 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 4/6 2021-02-06T22:51:12.625 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-02-06T22:51:12.717 INFO:teuthology.orchestra.run.smithi106.stdout:librados-devel-16.1.0-114.g39ebd5ec.el8.x86_64. 283 kB/s | 131 kB 00:00 2021-02-06T22:51:12.719 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:12.719 INFO:teuthology.orchestra.run.smithi106.stdout:Total 282 kB/s | 131 kB 00:00 2021-02-06T22:51:12.719 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:12.726 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:12.726 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:12.752 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:51:12.776 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:12.779 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:12.882 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:13.006 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 6/6 2021-02-06T22:51:13.007 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 1/6 2021-02-06T22:51:13.007 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 2/6 2021-02-06T22:51:13.007 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 3/6 2021-02-06T22:51:13.007 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2021-02-06T22:51:13.008 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2021-02-06T22:51:13.079 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:13.318 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:13.361 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 6/6 2021-02-06T22:51:13.361 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:13.361 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:13.362 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-mgr-cephadm-2:16.1.0-114.g39ebd5ec.el8.noarch 2021-02-06T22:51:13.362 INFO:teuthology.orchestra.run.smithi051.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-06T22:51:13.362 INFO:teuthology.orchestra.run.smithi051.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-06T22:51:13.362 INFO:teuthology.orchestra.run.smithi051.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-06T22:51:13.363 INFO:teuthology.orchestra.run.smithi051.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-06T22:51:13.363 INFO:teuthology.orchestra.run.smithi051.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-06T22:51:13.363 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:13.364 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:13.428 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install ceph-fuse 2021-02-06T22:51:13.636 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:13.636 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:13.636 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:13.637 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:13.637 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:13.637 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:13.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install libcephfs2 2021-02-06T22:51:13.911 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:47 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:14.294 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:48 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:14.375 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:14.376 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:14.376 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repository Size 2021-02-06T22:51:14.376 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:14.377 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:14.377 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-fuse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 875 k 2021-02-06T22:51:14.377 INFO:teuthology.orchestra.run.smithi051.stdout:Installing dependencies: 2021-02-06T22:51:14.377 INFO:teuthology.orchestra.run.smithi051.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-02-06T22:51:14.378 INFO:teuthology.orchestra.run.smithi051.stdout: fuse-common x86_64 3.2.1-12.el8 CentOS-Base 21 k 2021-02-06T22:51:14.378 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:14.378 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:14.378 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:14.379 INFO:teuthology.orchestra.run.smithi051.stdout:Install 3 Packages 2021-02-06T22:51:14.379 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:14.379 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 979 k 2021-02-06T22:51:14.380 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 2.8 M 2021-02-06T22:51:14.380 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:14.411 INFO:teuthology.orchestra.run.smithi051.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 82 kB 00:00 2021-02-06T22:51:14.413 INFO:teuthology.orchestra.run.smithi051.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 604 kB/s | 21 kB 00:00 2021-02-06T22:51:14.617 INFO:teuthology.orchestra.run.smithi051.stdout:(3/3): ceph-fuse-16.1.0-114.g39ebd5ec.el8.x86_6 3.6 MB/s | 875 kB 00:00 2021-02-06T22:51:14.619 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:14.620 INFO:teuthology.orchestra.run.smithi051.stdout:Total 3.9 MB/s | 979 kB 00:00 2021-02-06T22:51:14.622 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:14.639 INFO:teuthology.orchestra.run.smithi106.stdout:Package libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:14.646 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:14.646 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:14.725 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:14.727 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:14.752 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:14.753 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:14.754 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:14.855 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install libcephfs-devel 2021-02-06T22:51:14.950 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:14.950 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2021-02-06T22:51:14.950 INFO:teuthology.orchestra.run.smithi051.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-06T22:51:14.951 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:15.311 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:49 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:15.336 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-06T22:51:15.494 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/3 2021-02-06T22:51:15.766 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:15.768 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2021-02-06T22:51:15.768 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:15.768 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 24 k 2021-02-06T22:51:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:15.769 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:15.769 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:15.769 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:51:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:15.770 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 24 k 2021-02-06T22:51:15.770 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 89 k 2021-02-06T22:51:15.770 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:15.846 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 3/3 2021-02-06T22:51:15.846 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/3 2021-02-06T22:51:15.846 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-06T22:51:16.223 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2021-02-06T22:51:16.224 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:16.224 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:16.224 INFO:teuthology.orchestra.run.smithi051.stdout: ceph-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-02-06T22:51:16.225 INFO:teuthology.orchestra.run.smithi051.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-06T22:51:16.225 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:16.225 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:16.399 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install librados-devel 2021-02-06T22:51:16.683 INFO:teuthology.orchestra.run.smithi106.stdout:libcephfs-devel-16.1.0-114.g39ebd5ec.el8.x86_64 26 kB/s | 24 kB 00:00 2021-02-06T22:51:16.684 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:16.685 INFO:teuthology.orchestra.run.smithi106.stdout:Total 26 kB/s | 24 kB 00:00 2021-02-06T22:51:16.685 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:16.689 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:16.690 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:16.692 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:16.695 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:16.753 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:16.888 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:50 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:16.960 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:17.181 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:17.365 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:17.367 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:17.367 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2021-02-06T22:51:17.368 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:17.368 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:17.369 INFO:teuthology.orchestra.run.smithi051.stdout: librados-devel x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 131 k 2021-02-06T22:51:17.369 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:17.369 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:17.370 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:17.370 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:51:17.370 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:17.371 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 131 k 2021-02-06T22:51:17.371 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 431 k 2021-02-06T22:51:17.372 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:17.418 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:17.419 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:17.419 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:17.420 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:17.420 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:17.420 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:17.488 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librados2 2021-02-06T22:51:17.722 INFO:teuthology.orchestra.run.smithi051.stdout:librados-devel-16.1.0-114.g39ebd5ec.el8.x86_64. 369 kB/s | 131 kB 00:00 2021-02-06T22:51:17.723 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:17.723 INFO:teuthology.orchestra.run.smithi051.stdout:Total 368 kB/s | 131 kB 00:00 2021-02-06T22:51:17.723 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:17.731 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:17.732 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:17.786 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:17.788 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:17.928 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:17.941 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:51 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:18.117 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:18.280 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:18.373 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:18.391 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:18.392 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:18.392 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:18.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install librbd1 2021-02-06T22:51:18.693 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:18.693 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:18.694 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:18.694 INFO:teuthology.orchestra.run.smithi051.stdout: librados-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:18.694 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:18.694 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:18.839 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install libcephfs2 2021-02-06T22:51:18.914 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:52 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:19.263 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:19.331 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:53 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:19.374 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:19.376 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:19.376 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:19.448 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rados 2021-02-06T22:51:19.710 INFO:teuthology.orchestra.run.smithi051.stdout:Package libcephfs2-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:19.833 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:19.834 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:19.835 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:19.901 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:53 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:19.970 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install libcephfs-devel 2021-02-06T22:51:20.238 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:20.349 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:20.350 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:20.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rgw 2021-02-06T22:51:20.459 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:54 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:20.878 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:54 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:20.928 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:20.928 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:20.929 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2021-02-06T22:51:20.929 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:20.929 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:20.929 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs-devel x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 24 k 2021-02-06T22:51:20.930 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:20.930 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:20.930 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:20.930 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:51:20.930 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:20.931 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 24 k 2021-02-06T22:51:20.931 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 89 k 2021-02-06T22:51:20.932 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:21.057 INFO:teuthology.orchestra.run.smithi051.stdout:libcephfs-devel-16.1.0-114.g39ebd5ec.el8.x86_64 188 kB/s | 24 kB 00:00 2021-02-06T22:51:21.058 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:21.058 INFO:teuthology.orchestra.run.smithi051.stdout:Total 186 kB/s | 24 kB 00:00 2021-02-06T22:51:21.058 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:21.063 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:21.063 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:21.066 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:21.068 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:21.123 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:21.230 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:21.310 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:21.343 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:21.344 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:21.344 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:21.414 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-cephfs 2021-02-06T22:51:21.535 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:21.792 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:21.792 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:21.792 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:21.793 INFO:teuthology.orchestra.run.smithi051.stdout: libcephfs-devel-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:21.793 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:21.793 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:21.869 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install librados2 2021-02-06T22:51:21.870 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:55 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:22.238 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:22.354 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:22.355 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:22.355 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:22.356 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:56 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:22.422 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install python3-rbd 2021-02-06T22:51:22.735 INFO:teuthology.orchestra.run.smithi051.stdout:Package librados2-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:22.852 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:22.853 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:22.854 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:22.875 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:56 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:22.916 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install librbd1 2021-02-06T22:51:23.213 INFO:teuthology.orchestra.run.smithi106.stdout:Package python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:23.324 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:23.325 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2021-02-06T22:51:23.325 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:23.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-fuse 2021-02-06T22:51:23.403 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:57 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:23.768 INFO:teuthology.orchestra.run.smithi051.stdout:Package librbd1-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:23.840 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:57 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:23.885 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:23.886 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:23.886 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:23.950 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rados 2021-02-06T22:51:24.291 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:24.292 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:24.292 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2021-02-06T22:51:24.292 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:24.293 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 88 k 2021-02-06T22:51:24.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:24.293 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:24.293 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:24.294 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:51:24.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:24.294 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 88 k 2021-02-06T22:51:24.294 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 236 k 2021-02-06T22:51:24.295 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:24.434 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:58 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:24.440 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-fuse-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 598 kB/s | 88 kB 00:00 2021-02-06T22:51:24.440 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:24.440 INFO:teuthology.orchestra.run.smithi106.stdout:Total 593 kB/s | 88 kB 00:00 2021-02-06T22:51:24.441 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:24.452 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:24.453 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:24.502 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:24.504 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:24.609 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:24.793 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rados-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:24.911 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:24.913 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:24.913 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:24.972 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rgw 2021-02-06T22:51:25.459 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:01:59 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:25.720 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:25.826 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rgw-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:25.943 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:25.945 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:25.945 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:26.027 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-cephfs 2021-02-06T22:51:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:26.518 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:00 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:26.876 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-cephfs-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:26.994 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:26.995 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:26.996 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:27.056 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install python3-rbd 2021-02-06T22:51:27.057 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:27.058 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:27.058 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:27.059 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:27.173 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-mirror 2021-02-06T22:51:27.545 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:01 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:27.633 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:01 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:27.909 INFO:teuthology.orchestra.run.smithi051.stdout:Package python3-rbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 is already installed. 2021-02-06T22:51:28.026 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:28.027 INFO:teuthology.orchestra.run.smithi051.stdout:Nothing to do. 2021-02-06T22:51:28.027 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:28.098 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-fuse 2021-02-06T22:51:28.105 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:28.106 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repo Size 2021-02-06T22:51:28.107 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:28.107 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.6 M 2021-02-06T22:51:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:28.108 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:28.108 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:28.108 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:51:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:28.110 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 3.6 M 2021-02-06T22:51:28.110 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 15 M 2021-02-06T22:51:28.110 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:28.451 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-mirror-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 11 MB/s | 3.6 MB 00:00 2021-02-06T22:51:28.452 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:28.453 INFO:teuthology.orchestra.run.smithi106.stdout:Total 11 MB/s | 3.6 MB 00:00 2021-02-06T22:51:28.453 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:28.467 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:28.467 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:28.530 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:28.532 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:28.585 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:02 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:29.016 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:29.091 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:29.092 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:29.093 INFO:teuthology.orchestra.run.smithi051.stdout: Package Architecture Version Repository Size 2021-02-06T22:51:29.093 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:29.093 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:29.093 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-fuse x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 88 k 2021-02-06T22:51:29.094 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:29.094 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:29.094 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:29.094 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:51:29.095 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:29.095 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 88 k 2021-02-06T22:51:29.095 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 236 k 2021-02-06T22:51:29.095 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:29.204 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:29.241 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-fuse-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 595 kB/s | 88 kB 00:00 2021-02-06T22:51:29.242 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:29.243 INFO:teuthology.orchestra.run.smithi051.stdout:Total 590 kB/s | 88 kB 00:00 2021-02-06T22:51:29.243 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:29.255 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:29.256 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:29.309 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:29.311 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:29.420 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:29.538 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:29.615 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:29.826 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:29.827 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:29.827 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:29.827 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:29.885 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:29.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install rbd-nbd 2021-02-06T22:51:30.446 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:02:04 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:30.632 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:30.633 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:30.633 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:30.633 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-fuse-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:30.633 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:30.634 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:30.907 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2021-02-06T22:51:30.908 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:30.908 INFO:teuthology.orchestra.run.smithi106.stdout: Package Architecture Version Repository Size 2021-02-06T22:51:30.908 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:30.908 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2021-02-06T22:51:30.909 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 171 k 2021-02-06T22:51:30.909 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:30.909 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2021-02-06T22:51:30.909 INFO:teuthology.orchestra.run.smithi106.stdout:================================================================================ 2021-02-06T22:51:30.909 INFO:teuthology.orchestra.run.smithi106.stdout:Install 1 Package 2021-02-06T22:51:30.910 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:30.910 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 171 k 2021-02-06T22:51:30.910 INFO:teuthology.orchestra.run.smithi106.stdout:Installed size: 511 k 2021-02-06T22:51:30.910 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2021-02-06T22:51:31.080 INFO:teuthology.orchestra.run.smithi106.stdout:rbd-nbd-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 1.0 MB/s | 171 kB 00:00 2021-02-06T22:51:31.080 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:31.081 INFO:teuthology.orchestra.run.smithi106.stdout:Total 994 kB/s | 171 kB 00:00 2021-02-06T22:51:31.081 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2021-02-06T22:51:31.094 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2021-02-06T22:51:31.094 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2021-02-06T22:51:31.144 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2021-02-06T22:51:31.147 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2021-02-06T22:51:31.256 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2021-02-06T22:51:31.510 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:31.745 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:31.919 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-mirror 2021-02-06T22:51:32.092 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:32.092 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:32.093 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2021-02-06T22:51:32.093 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:32.093 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:32.093 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2021-02-06T22:51:32.268 DEBUG:teuthology.parallel:result is None 2021-02-06T22:51:32.416 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:06 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:32.960 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:32.961 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:32.961 INFO:teuthology.orchestra.run.smithi051.stdout: Package Arch Version Repo Size 2021-02-06T22:51:32.961 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:32.961 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:32.962 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-mirror x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 3.6 M 2021-02-06T22:51:32.962 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:32.962 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:32.962 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:32.962 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:51:32.963 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:32.963 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 3.6 M 2021-02-06T22:51:32.963 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 15 M 2021-02-06T22:51:32.963 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:33.909 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-mirror-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 3.9 MB/s | 3.6 MB 00:00 2021-02-06T22:51:33.909 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:33.910 INFO:teuthology.orchestra.run.smithi051.stdout:Total 3.8 MB/s | 3.6 MB 00:00 2021-02-06T22:51:33.910 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:33.926 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:33.926 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:33.995 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:33.998 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:34.490 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:34.641 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:35.029 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:35.341 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:35.341 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:35.342 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:35.342 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-mirror-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:35.342 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:35.342 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:35.483 DEBUG:teuthology.orchestra.run.smithi051:> sudo yum -y install rbd-nbd 2021-02-06T22:51:35.979 INFO:teuthology.orchestra.run.smithi051.stdout:Last metadata expiration check: 0:02:09 ago on Sat 06 Feb 2021 10:49:26 PM UTC. 2021-02-06T22:51:36.477 INFO:teuthology.orchestra.run.smithi051.stdout:Dependencies resolved. 2021-02-06T22:51:36.478 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:36.478 INFO:teuthology.orchestra.run.smithi051.stdout: Package Architecture Version Repository Size 2021-02-06T22:51:36.478 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:36.478 INFO:teuthology.orchestra.run.smithi051.stdout:Installing: 2021-02-06T22:51:36.478 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-nbd x86_64 2:16.1.0-114.g39ebd5ec.el8 ceph 171 k 2021-02-06T22:51:36.479 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:36.479 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction Summary 2021-02-06T22:51:36.479 INFO:teuthology.orchestra.run.smithi051.stdout:================================================================================ 2021-02-06T22:51:36.479 INFO:teuthology.orchestra.run.smithi051.stdout:Install 1 Package 2021-02-06T22:51:36.480 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:36.480 INFO:teuthology.orchestra.run.smithi051.stdout:Total download size: 171 k 2021-02-06T22:51:36.480 INFO:teuthology.orchestra.run.smithi051.stdout:Installed size: 511 k 2021-02-06T22:51:36.480 INFO:teuthology.orchestra.run.smithi051.stdout:Downloading Packages: 2021-02-06T22:51:36.933 INFO:teuthology.orchestra.run.smithi051.stdout:rbd-nbd-16.1.0-114.g39ebd5ec.el8.x86_64.rpm 377 kB/s | 171 kB 00:00 2021-02-06T22:51:36.934 INFO:teuthology.orchestra.run.smithi051.stdout:-------------------------------------------------------------------------------- 2021-02-06T22:51:36.935 INFO:teuthology.orchestra.run.smithi051.stdout:Total 376 kB/s | 171 kB 00:00 2021-02-06T22:51:36.935 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction check 2021-02-06T22:51:36.950 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction check succeeded. 2021-02-06T22:51:36.950 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction test 2021-02-06T22:51:37.007 INFO:teuthology.orchestra.run.smithi051.stdout:Transaction test succeeded. 2021-02-06T22:51:37.010 INFO:teuthology.orchestra.run.smithi051.stdout:Running transaction 2021-02-06T22:51:37.130 INFO:teuthology.orchestra.run.smithi051.stdout: Preparing : 1/1 2021-02-06T22:51:37.356 INFO:teuthology.orchestra.run.smithi051.stdout: Installing : rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:37.599 INFO:teuthology.orchestra.run.smithi051.stdout: Running scriptlet: rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:38.522 INFO:teuthology.orchestra.run.smithi051.stdout: Verifying : rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 1/1 2021-02-06T22:51:38.522 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:38.522 INFO:teuthology.orchestra.run.smithi051.stdout:Installed: 2021-02-06T22:51:38.523 INFO:teuthology.orchestra.run.smithi051.stdout: rbd-nbd-2:16.1.0-114.g39ebd5ec.el8.x86_64 2021-02-06T22:51:38.523 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:38.523 INFO:teuthology.orchestra.run.smithi051.stdout:Complete! 2021-02-06T22:51:38.797 DEBUG:teuthology.parallel:result is None 2021-02-06T22:51:38.798 DEBUG:teuthology.orchestra.run.smithi051:> sudo lsb_release -is 2021-02-06T22:51:38.837 INFO:teuthology.orchestra.run.smithi051.stdout:CentOS 2021-02-06T22:51:38.839 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:51:38.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=39ebd5ec4ebd7319faeb68d09b00b18fb45299cc 2021-02-06T22:51:39.004 DEBUG:teuthology.orchestra.run.smithi051:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-06T22:51:39.028 INFO:teuthology.orchestra.run.smithi051.stdout:16.1.0-114.g39ebd5ec.el8 2021-02-06T22:51:39.028 INFO:teuthology.packaging:The installed version of ceph is 16.1.0-114.g39ebd5ec.el8 2021-02-06T22:51:39.029 INFO:teuthology.task.install:The correct ceph version 16.1.0-114.g39ebd5ec is installed. 2021-02-06T22:51:39.029 DEBUG:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2021-02-06T22:51:39.071 INFO:teuthology.orchestra.run.smithi106.stdout:CentOS 2021-02-06T22:51:39.072 DEBUG:teuthology.misc:System to be installed: CentOS 2021-02-06T22:51:39.073 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=39ebd5ec4ebd7319faeb68d09b00b18fb45299cc 2021-02-06T22:51:39.241 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-06T22:51:39.264 INFO:teuthology.orchestra.run.smithi106.stdout:16.1.0-114.g39ebd5ec.el8 2021-02-06T22:51:39.264 INFO:teuthology.packaging:The installed version of ceph is 16.1.0-114.g39ebd5ec.el8 2021-02-06T22:51:39.265 INFO:teuthology.task.install:The correct ceph version 16.1.0-114.g39ebd5ec is installed. 2021-02-06T22:51:39.265 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-06T22:51:39.265 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:39.266 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-06T22:51:39.296 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:39.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-06T22:51:39.332 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-06T22:51:39.332 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:39.332 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/usr/bin/daemon-helper 2021-02-06T22:51:39.366 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-06T22:51:39.435 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:39.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2021-02-06T22:51:39.463 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-06T22:51:39.529 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-06T22:51:39.529 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:39.530 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-06T22:51:39.559 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-06T22:51:39.627 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:39.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-06T22:51:39.653 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-06T22:51:39.719 INFO:teuthology.run_tasks:Running task ceph... 2021-02-06T22:51:39.777 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-06T22:51:39.778 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 777 /var/log/ceph 2021-02-06T22:51:39.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2021-02-06T22:51:39.808 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-06T22:51:39.809 DEBUG:teuthology.orchestra.run.smithi051:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-06T22:51:39.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-06T22:51:39.878 INFO:tasks.ceph:Creating extra log directories... 2021-02-06T22:51:39.879 DEBUG:teuthology.orchestra.run.smithi051:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-06T22:51:39.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-06T22:51:39.957 INFO:tasks.ceph:Creating ceph cluster ceph... 2021-02-06T22:51:39.957 INFO:tasks.ceph:config {'conf': {'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2021-02-06T22:51:39.958 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482', 'branch': 'wip-yuri7-testing-2021-02-02-0942-pacific', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5862482', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.2', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2021-02-02-0942-pacific'}, 'ceph': {'conf': {'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2021-02-02-0942-pacific', 'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri7-testing-2021-02-02-0942-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '39ebd5ec4ebd7319faeb68d09b00b18fb45299cc', 'targets': {'smithi051.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjrPeE+qpRsebVTSNeTgeYTJxASEQ3UAZtzufwYKkhrqnSEQmbL4oUieaEIsqou3HWw0bIK0FszBAJsIGcfRhT8i8PKBCzH73E77F+9coJX/kjuuqmh7wYDMhGI3v3gl0kL/8zwr5Z9Q6JiBdHgHdPFmmcKUQZCt1xF0ssYMCNp12VDioB5x4FpVCcfHL61SxuHnLffxH3MywAcWAXCMxWH+PdiH5HPHwCXUxC5JkoTLdq1zyXvEq+K/KnOkpAH2k3h7GDwUfSjifRZ7ZjBJGUON693loYPBsl6rhUF9XSF8CI6bl2oQ963Z1jfGvg+wtNFtTMLNjE+Pl4/26ZpXFPZ4S1qipDe7E1oAIokmBzbSEVFuZBVmBIdf0XX6NqnW9Ms1BTwn9rdSEWa0jjYKNUmDoPhtiftfGCb7xQEMd/lozHi2oWIDSlPhDb9NMNdekV8qFy+hWDKHCSTHQwhO+E5LFoWgtCir1Uw/I4xmNAjiLF0T5TQcsqTw1V6bCdFJ0=', 'smithi106.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnQTjyZoqdhr0NhIt5gsZMttHBL2P8pNn2mwcUMnfGUna9bxNk0lrsNj4rSxN/DrNngVeIlF4LwBPGnxxxiRD4rue6QN45eiq5SYnD5NuF6zY0DkkNbW2n67ukIy+u7IrpOqx+WQB4jy9GdyrebU31z8GvN6TESNuuu4MAkRMe0EjPg8rYwFEVGiZbo2U7tAgrf5oxls3LOnBJVXIPL/xUp6bpXTWXS6NYj2E2qJhLSo8Bt6G3W4qR490SPSb2LJFQ6jLC0TpgqPRWSoRDHQ5xKSoiqrff4t9a6Bv3H5GAkZCiiyD2tz9Yup/DWJz3KYUL1eW4PuMvkhLgotvOczBZitjTdNJHShtejXbdaDw+YhmWOkS0XwsISZC7tigKR1o8ZPgGi5sOWDYZN8rveWKhi0/nnFmMeK7WVbGefaIV4XdDsj80XtkF30RatbiVMszHJLqnXAhge59fCzuKFKbWO8rtg3ZrblZAPVbqwGrI5CAE9MwYnrU8jrtF/V1M5s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '17c099650191e7aa47a7d9f502facca74f9b4d44', 'timestamp': '2021-02-06_18:09:20', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.14226'} 2021-02-06T22:51:39.959 DEBUG:teuthology.orchestra.run.smithi051:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-06T22:51:39.991 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2021-02-06T22:51:40.006 DEBUG:teuthology.orchestra.run.smithi051:> sudo install -d -m0777 -- /var/run/ceph 2021-02-06T22:51:40.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2021-02-06T22:51:40.073 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:40.073 DEBUG:teuthology.orchestra.run.smithi051:> dd if=/scratch_devs of=/dev/stdout 2021-02-06T22:51:40.129 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-06T22:51:40.130 DEBUG:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-06T22:51:40.185 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-06T22:51:40.186 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.186 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 112475 Links: 1 2021-02-06T22:51:40.186 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.187 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.187 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2021-02-06 22:51:34.825957763 +0000 2021-02-06T22:51:40.187 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2021-02-06 22:48:54.885556336 +0000 2021-02-06T22:51:40.187 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2021-02-06 22:48:54.885556336 +0000 2021-02-06T22:51:40.187 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2021-02-06T22:51:40.198 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2021-02-06T22:51:40.198 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2021-02-06T22:51:40.198 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000251092 s, 2.0 MB/s 2021-02-06T22:51:40.201 DEBUG:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-06T22:51:40.257 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-06T22:51:40.257 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.258 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 112587 Links: 1 2021-02-06T22:51:40.258 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.258 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.258 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2021-02-06 22:51:34.826957748 +0000 2021-02-06T22:51:40.259 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2021-02-06 22:48:55.226551110 +0000 2021-02-06T22:51:40.259 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2021-02-06 22:48:55.226551110 +0000 2021-02-06T22:51:40.259 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2021-02-06T22:51:40.269 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2021-02-06T22:51:40.269 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2021-02-06T22:51:40.269 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.00021019 s, 2.4 MB/s 2021-02-06T22:51:40.272 DEBUG:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-06T22:51:40.328 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-06T22:51:40.328 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.329 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 105429 Links: 1 2021-02-06T22:51:40.329 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.329 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.329 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2021-02-06 22:51:34.826957748 +0000 2021-02-06T22:51:40.329 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2021-02-06 22:48:55.599545395 +0000 2021-02-06T22:51:40.330 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2021-02-06 22:48:55.599545395 +0000 2021-02-06T22:51:40.330 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2021-02-06T22:51:40.339 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2021-02-06T22:51:40.340 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2021-02-06T22:51:40.340 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000239935 s, 2.1 MB/s 2021-02-06T22:51:40.342 DEBUG:teuthology.orchestra.run.smithi051:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-06T22:51:40.398 INFO:teuthology.orchestra.run.smithi051.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-06T22:51:40.399 INFO:teuthology.orchestra.run.smithi051.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.399 INFO:teuthology.orchestra.run.smithi051.stdout:Device: 6h/6d Inode: 104416 Links: 1 2021-02-06T22:51:40.399 INFO:teuthology.orchestra.run.smithi051.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.399 INFO:teuthology.orchestra.run.smithi051.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.400 INFO:teuthology.orchestra.run.smithi051.stdout:Access: 2021-02-06 22:51:34.826957748 +0000 2021-02-06T22:51:40.400 INFO:teuthology.orchestra.run.smithi051.stdout:Modify: 2021-02-06 22:48:55.932540292 +0000 2021-02-06T22:51:40.400 INFO:teuthology.orchestra.run.smithi051.stdout:Change: 2021-02-06 22:48:55.932540292 +0000 2021-02-06T22:51:40.400 INFO:teuthology.orchestra.run.smithi051.stdout: Birth: - 2021-02-06T22:51:40.410 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records in 2021-02-06T22:51:40.410 INFO:teuthology.orchestra.run.smithi051.stderr:1+0 records out 2021-02-06T22:51:40.411 INFO:teuthology.orchestra.run.smithi051.stderr:512 bytes copied, 0.000210338 s, 2.4 MB/s 2021-02-06T22:51:40.413 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:40.413 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:40.414 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2021-02-06T22:51:40.428 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-06T22:51:40.429 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-06T22:51:40.482 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-06T22:51:40.483 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.483 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 111177 Links: 1 2021-02-06T22:51:40.483 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.483 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.484 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-02-06 22:51:29.350154208 +0000 2021-02-06T22:51:40.484 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-02-06 22:48:45.301152144 +0000 2021-02-06T22:51:40.484 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-02-06 22:48:45.301152144 +0000 2021-02-06T22:51:40.484 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-02-06T22:51:40.493 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-02-06T22:51:40.493 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-02-06T22:51:40.493 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000224168 s, 2.3 MB/s 2021-02-06T22:51:40.496 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-06T22:51:40.550 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-06T22:51:40.551 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.551 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 107437 Links: 1 2021-02-06T22:51:40.551 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.551 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.552 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-02-06 22:51:29.350154208 +0000 2021-02-06T22:51:40.552 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-02-06 22:48:45.645144216 +0000 2021-02-06T22:51:40.552 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-02-06 22:48:45.645144216 +0000 2021-02-06T22:51:40.552 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-02-06T22:51:40.561 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-02-06T22:51:40.561 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-02-06T22:51:40.561 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000204914 s, 2.5 MB/s 2021-02-06T22:51:40.563 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-06T22:51:40.617 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-06T22:51:40.618 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.618 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 110192 Links: 1 2021-02-06T22:51:40.618 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.618 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.619 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-02-06 22:51:29.350154208 +0000 2021-02-06T22:51:40.619 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-02-06 22:48:45.978136541 +0000 2021-02-06T22:51:40.619 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-02-06 22:48:45.978136541 +0000 2021-02-06T22:51:40.619 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-02-06T22:51:40.627 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-02-06T22:51:40.628 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-02-06T22:51:40.628 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000271953 s, 1.9 MB/s 2021-02-06T22:51:40.630 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-06T22:51:40.684 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-06T22:51:40.685 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-06T22:51:40.685 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 113792 Links: 1 2021-02-06T22:51:40.685 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-06T22:51:40.685 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2021-02-06T22:51:40.685 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2021-02-06 22:51:29.350154208 +0000 2021-02-06T22:51:40.686 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2021-02-06 22:48:46.315128774 +0000 2021-02-06T22:51:40.686 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2021-02-06 22:48:46.315128774 +0000 2021-02-06T22:51:40.687 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2021-02-06T22:51:40.694 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2021-02-06T22:51:40.694 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2021-02-06T22:51:40.695 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000201557 s, 2.5 MB/s 2021-02-06T22:51:40.697 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:40.697 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-02-06T22:51:40.698 INFO:tasks.ceph:Generating config... 2021-02-06T22:51:40.699 INFO:tasks.ceph:[global] debug ms = 1 2021-02-06T22:51:40.700 INFO:tasks.ceph:[global] debug objecter = 20 2021-02-06T22:51:40.700 INFO:tasks.ceph:[global] debug rados = 20 2021-02-06T22:51:40.700 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-02-06T22:51:40.700 INFO:tasks.ceph:[global] mon election default strategy = 1 2021-02-06T22:51:40.701 INFO:tasks.ceph:[global] ms bind msgr2 = False 2021-02-06T22:51:40.701 INFO:tasks.ceph:[global] ms inject delay max = 1 2021-02-06T22:51:40.701 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2021-02-06T22:51:40.702 INFO:tasks.ceph:[global] ms inject delay type = mon 2021-02-06T22:51:40.702 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2021-02-06T22:51:40.702 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2021-02-06T22:51:40.702 INFO:tasks.ceph:[global] ms type = async 2021-02-06T22:51:40.703 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-06T22:51:40.703 INFO:tasks.ceph:[mgr] debug monc = 10 2021-02-06T22:51:40.703 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-06T22:51:40.704 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-06T22:51:40.704 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-06T22:51:40.704 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-06T22:51:40.704 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2021-02-06T22:51:40.705 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2021-02-06T22:51:40.705 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2021-02-06T22:51:40.705 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2021-02-06T22:51:40.706 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2021-02-06T22:51:40.706 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2021-02-06T22:51:40.706 INFO:tasks.ceph:[mon] mon scrub interval = 300 2021-02-06T22:51:40.706 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2021-02-06T22:51:40.707 INFO:tasks.ceph:[mon] paxos service trim min = 5 2021-02-06T22:51:40.707 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-02-06T22:51:40.707 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2021-02-06T22:51:40.708 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2021-02-06T22:51:40.708 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-02-06T22:51:40.708 INFO:tasks.ceph:[osd] debug bluefs = 20 2021-02-06T22:51:40.708 INFO:tasks.ceph:[osd] debug bluestore = 20 2021-02-06T22:51:40.709 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-06T22:51:40.709 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-06T22:51:40.709 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-06T22:51:40.709 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-06T22:51:40.710 INFO:tasks.ceph:[osd] debug rocksdb = 10 2021-02-06T22:51:40.710 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-02-06T22:51:40.710 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-02-06T22:51:40.711 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-02-06T22:51:40.711 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2021-02-06T22:51:40.711 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2021-02-06T22:51:40.711 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-02-06T22:51:40.712 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-02-06T22:51:40.712 INFO:tasks.ceph:[osd] osd op queue = debug_random 2021-02-06T22:51:40.712 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2021-02-06T22:51:40.713 INFO:tasks.ceph:Setting up mon.a... 2021-02-06T22:51:40.713 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2021-02-06T22:51:40.782 INFO:teuthology.orchestra.run.smithi051.stdout:creating /etc/ceph/ceph.keyring 2021-02-06T22:51:40.784 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2021-02-06T22:51:40.827 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-06T22:51:40.894 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.51:6789]'), ('mon.c', '[v1:172.21.15.51:6790]'), ('mon.b', '[v1:172.21.15.106:6789]')] 2021-02-06T22:51:40.895 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.51:6789],[v1:172.21.15.51:6790],[v1:172.21.15.106:6789]', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2021-02-06T22:51:40.896 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:40.897 DEBUG:teuthology.orchestra.run.smithi051:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-02-06T22:51:40.950 DEBUG:teuthology.orchestra.run.smithi051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.51:6789]' --addv c '[v1:172.21.15.51:6790]' --addv b '[v1:172.21.15.106:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:41.032 INFO:teuthology.orchestra.run.smithi051.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:41.033 INFO:teuthology.orchestra.run.smithi051.stdout:monmaptool: generated fsid 4c1ae418-80db-4910-bad7-3f0133db4245 2021-02-06T22:51:41.033 INFO:teuthology.orchestra.run.smithi051.stdout:epoch 0 2021-02-06T22:51:41.033 INFO:teuthology.orchestra.run.smithi051.stdout:fsid 4c1ae418-80db-4910-bad7-3f0133db4245 2021-02-06T22:51:41.033 INFO:teuthology.orchestra.run.smithi051.stdout:last_changed 2021-02-06T22:51:41.034002+0000 2021-02-06T22:51:41.033 INFO:teuthology.orchestra.run.smithi051.stdout:created 2021-02-06T22:51:41.034002+0000 2021-02-06T22:51:41.034 INFO:teuthology.orchestra.run.smithi051.stdout:min_mon_release 0 (unknown) 2021-02-06T22:51:41.034 INFO:teuthology.orchestra.run.smithi051.stdout:election_strategy: 1 2021-02-06T22:51:41.034 INFO:teuthology.orchestra.run.smithi051.stdout:0: v1:172.21.15.51:6789/0 mon.a 2021-02-06T22:51:41.034 INFO:teuthology.orchestra.run.smithi051.stdout:1: v1:172.21.15.106:6789/0 mon.b 2021-02-06T22:51:41.034 INFO:teuthology.orchestra.run.smithi051.stdout:2: v1:172.21.15.51:6790/0 mon.c 2021-02-06T22:51:41.035 INFO:teuthology.orchestra.run.smithi051.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2021-02-06T22:51:41.036 DEBUG:teuthology.orchestra.run.smithi051:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-02-06T22:51:41.090 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4c1ae418-80db-4910-bad7-3f0133db4245... 2021-02-06T22:51:41.091 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-06T22:51:41.133 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2021-02-06T22:51:41.178 INFO:teuthology.orchestra.run.smithi051.stdout:[global] 2021-02-06T22:51:41.178 INFO:teuthology.orchestra.run.smithi051.stdout: chdir = "" 2021-02-06T22:51:41.178 INFO:teuthology.orchestra.run.smithi051.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-06T22:51:41.178 INFO:teuthology.orchestra.run.smithi051.stdout: auth supported = cephx 2021-02-06T22:51:41.179 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.179 INFO:teuthology.orchestra.run.smithi051.stdout: filestore xattr use omap = true 2021-02-06T22:51:41.179 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.179 INFO:teuthology.orchestra.run.smithi051.stdout: mon clock drift allowed = 1.000 2021-02-06T22:51:41.180 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.180 INFO:teuthology.orchestra.run.smithi051.stdout: osd crush chooseleaf type = 0 2021-02-06T22:51:41.180 INFO:teuthology.orchestra.run.smithi051.stdout: auth debug = true 2021-02-06T22:51:41.180 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.180 INFO:teuthology.orchestra.run.smithi051.stdout: ms die on old message = true 2021-02-06T22:51:41.181 INFO:teuthology.orchestra.run.smithi051.stdout: ms die on bug = true 2021-02-06T22:51:41.181 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.181 INFO:teuthology.orchestra.run.smithi051.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-06T22:51:41.181 INFO:teuthology.orchestra.run.smithi051.stdout: mon pg warn max object skew = 0 2021-02-06T22:51:41.182 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.182 INFO:teuthology.orchestra.run.smithi051.stdout: # disable pg_autoscaler by default for new pools 2021-02-06T22:51:41.182 INFO:teuthology.orchestra.run.smithi051.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-06T22:51:41.182 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.182 INFO:teuthology.orchestra.run.smithi051.stdout: osd pool default size = 2 2021-02-06T22:51:41.183 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.183 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd allow primary affinity = true 2021-02-06T22:51:41.183 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd allow pg remap = true 2021-02-06T22:51:41.183 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on legacy crush tunables = false 2021-02-06T22:51:41.183 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on crush straw calc version zero = false 2021-02-06T22:51:41.184 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on no sortbitwise = false 2021-02-06T22:51:41.184 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on osd down out interval zero = false 2021-02-06T22:51:41.184 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on too few osds = false 2021-02-06T22:51:41.184 INFO:teuthology.orchestra.run.smithi051.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-06T22:51:41.184 INFO:teuthology.orchestra.run.smithi051.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-06T22:51:41.185 INFO:teuthology.orchestra.run.smithi051.stdout: mon_allow_pool_size_one = true 2021-02-06T22:51:41.185 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.185 INFO:teuthology.orchestra.run.smithi051.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-06T22:51:41.185 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.185 INFO:teuthology.orchestra.run.smithi051.stdout: osd default data pool replay window = 5 2021-02-06T22:51:41.186 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.186 INFO:teuthology.orchestra.run.smithi051.stdout: mon allow pool delete = true 2021-02-06T22:51:41.186 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.186 INFO:teuthology.orchestra.run.smithi051.stdout: mon cluster log file level = debug 2021-02-06T22:51:41.187 INFO:teuthology.orchestra.run.smithi051.stdout: debug asserts on shutdown = true 2021-02-06T22:51:41.187 INFO:teuthology.orchestra.run.smithi051.stdout: mon health detail to clog = false 2021-02-06T22:51:41.187 INFO:teuthology.orchestra.run.smithi051.stdout: mon host = "[v1:172.21.15.51:6789],[v1:172.21.15.51:6790],[v1:172.21.15.106:6789]" 2021-02-06T22:51:41.187 INFO:teuthology.orchestra.run.smithi051.stdout: debug ms = 1 2021-02-06T22:51:41.187 INFO:teuthology.orchestra.run.smithi051.stdout: debug objecter = 20 2021-02-06T22:51:41.188 INFO:teuthology.orchestra.run.smithi051.stdout: debug rados = 20 2021-02-06T22:51:41.188 INFO:teuthology.orchestra.run.smithi051.stdout: mon client directed command retry = 5 2021-02-06T22:51:41.188 INFO:teuthology.orchestra.run.smithi051.stdout: mon election default strategy = 1 2021-02-06T22:51:41.188 INFO:teuthology.orchestra.run.smithi051.stdout: ms bind msgr2 = False 2021-02-06T22:51:41.188 INFO:teuthology.orchestra.run.smithi051.stdout: ms inject delay max = 1 2021-02-06T22:51:41.189 INFO:teuthology.orchestra.run.smithi051.stdout: ms inject delay probability = 0.005 2021-02-06T22:51:41.189 INFO:teuthology.orchestra.run.smithi051.stdout: ms inject delay type = mon 2021-02-06T22:51:41.189 INFO:teuthology.orchestra.run.smithi051.stdout: ms inject internal delays = 0.002 2021-02-06T22:51:41.189 INFO:teuthology.orchestra.run.smithi051.stdout: ms inject socket failures = 2500 2021-02-06T22:51:41.189 INFO:teuthology.orchestra.run.smithi051.stdout: ms type = async 2021-02-06T22:51:41.190 INFO:teuthology.orchestra.run.smithi051.stdout: fsid = 4c1ae418-80db-4910-bad7-3f0133db4245 2021-02-06T22:51:41.190 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.190 INFO:teuthology.orchestra.run.smithi051.stdout:[osd] 2021-02-06T22:51:41.190 INFO:teuthology.orchestra.run.smithi051.stdout: osd journal size = 100 2021-02-06T22:51:41.190 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.191 INFO:teuthology.orchestra.run.smithi051.stdout: osd scrub load threshold = 5.0 2021-02-06T22:51:41.191 INFO:teuthology.orchestra.run.smithi051.stdout: osd scrub max interval = 600 2021-02-06T22:51:41.191 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.191 INFO:teuthology.orchestra.run.smithi051.stdout: osd recover clone overlap = true 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: osd recovery max chunk = 1048576 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug shutdown = true 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug op order = true 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug verify stray on activate = true 2021-02-06T22:51:41.192 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.193 INFO:teuthology.orchestra.run.smithi051.stdout: osd open classes on start = true 2021-02-06T22:51:41.193 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug pg log writeout = true 2021-02-06T22:51:41.193 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.193 INFO:teuthology.orchestra.run.smithi051.stdout: osd deep scrub update digest min age = 30 2021-02-06T22:51:41.193 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.194 INFO:teuthology.orchestra.run.smithi051.stdout: osd map max advance = 10 2021-02-06T22:51:41.194 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.194 INFO:teuthology.orchestra.run.smithi051.stdout: journal zero on create = true 2021-02-06T22:51:41.194 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.194 INFO:teuthology.orchestra.run.smithi051.stdout: filestore ondisk finisher threads = 3 2021-02-06T22:51:41.195 INFO:teuthology.orchestra.run.smithi051.stdout: filestore apply finisher threads = 3 2021-02-06T22:51:41.195 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.195 INFO:teuthology.orchestra.run.smithi051.stdout: bdev debug aio = true 2021-02-06T22:51:41.195 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug misdirected ops = true 2021-02-06T22:51:41.195 INFO:teuthology.orchestra.run.smithi051.stdout: bluestore block size = 96636764160 2021-02-06T22:51:41.196 INFO:teuthology.orchestra.run.smithi051.stdout: bluestore compression algorithm = zstd 2021-02-06T22:51:41.196 INFO:teuthology.orchestra.run.smithi051.stdout: bluestore compression mode = aggressive 2021-02-06T22:51:41.196 INFO:teuthology.orchestra.run.smithi051.stdout: bluestore fsck on mount = True 2021-02-06T22:51:41.196 INFO:teuthology.orchestra.run.smithi051.stdout: debug bluefs = 20 2021-02-06T22:51:41.196 INFO:teuthology.orchestra.run.smithi051.stdout: debug bluestore = 20 2021-02-06T22:51:41.197 INFO:teuthology.orchestra.run.smithi051.stdout: debug filestore = 20 2021-02-06T22:51:41.197 INFO:teuthology.orchestra.run.smithi051.stdout: debug journal = 20 2021-02-06T22:51:41.197 INFO:teuthology.orchestra.run.smithi051.stdout: debug ms = 20 2021-02-06T22:51:41.197 INFO:teuthology.orchestra.run.smithi051.stdout: debug osd = 25 2021-02-06T22:51:41.198 INFO:teuthology.orchestra.run.smithi051.stdout: debug rocksdb = 10 2021-02-06T22:51:41.198 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd backfillfull_ratio = 0.85 2021-02-06T22:51:41.198 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd full ratio = 0.9 2021-02-06T22:51:41.198 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd nearfull ratio = 0.8 2021-02-06T22:51:41.198 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug verify cached snaps = True 2021-02-06T22:51:41.199 INFO:teuthology.orchestra.run.smithi051.stdout: osd debug verify missing on start = True 2021-02-06T22:51:41.199 INFO:teuthology.orchestra.run.smithi051.stdout: osd failsafe full ratio = 0.95 2021-02-06T22:51:41.199 INFO:teuthology.orchestra.run.smithi051.stdout: osd objectstore = bluestore 2021-02-06T22:51:41.199 INFO:teuthology.orchestra.run.smithi051.stdout: osd op queue = debug_random 2021-02-06T22:51:41.200 INFO:teuthology.orchestra.run.smithi051.stdout: osd op queue cut off = debug_random 2021-02-06T22:51:41.200 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.200 INFO:teuthology.orchestra.run.smithi051.stdout:[mgr] 2021-02-06T22:51:41.200 INFO:teuthology.orchestra.run.smithi051.stdout: debug ms = 1 2021-02-06T22:51:41.200 INFO:teuthology.orchestra.run.smithi051.stdout: debug mgr = 20 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: debug mon = 20 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: debug auth = 20 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: mon reweight min pgs per osd = 4 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: mon reweight min bytes per osd = 10 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: mgr/telemetry/nag = false 2021-02-06T22:51:41.201 INFO:teuthology.orchestra.run.smithi051.stdout: debug monc = 10 2021-02-06T22:51:41.202 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.202 INFO:teuthology.orchestra.run.smithi051.stdout:[mon] 2021-02-06T22:51:41.202 INFO:teuthology.orchestra.run.smithi051.stdout: debug ms = 1 2021-02-06T22:51:41.202 INFO:teuthology.orchestra.run.smithi051.stdout: debug mon = 20 2021-02-06T22:51:41.203 INFO:teuthology.orchestra.run.smithi051.stdout: debug paxos = 20 2021-02-06T22:51:41.203 INFO:teuthology.orchestra.run.smithi051.stdout: debug auth = 20 2021-02-06T22:51:41.203 INFO:teuthology.orchestra.run.smithi051.stdout: mon data avail warn = 5 2021-02-06T22:51:41.203 INFO:teuthology.orchestra.run.smithi051.stdout: mon mgr mkfs grace = 240 2021-02-06T22:51:41.203 INFO:teuthology.orchestra.run.smithi051.stdout: mon reweight min pgs per osd = 4 2021-02-06T22:51:41.204 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd reporter subtree level = osd 2021-02-06T22:51:41.204 INFO:teuthology.orchestra.run.smithi051.stdout: mon osd prime pg temp = true 2021-02-06T22:51:41.204 INFO:teuthology.orchestra.run.smithi051.stdout: mon reweight min bytes per osd = 10 2021-02-06T22:51:41.204 INFO:teuthology.orchestra.run.smithi051.stdout: mon min osdmap epochs = 25 2021-02-06T22:51:41.204 INFO:teuthology.orchestra.run.smithi051.stdout: mon osdmap full prune interval = 2 2021-02-06T22:51:41.205 INFO:teuthology.orchestra.run.smithi051.stdout: mon osdmap full prune min = 15 2021-02-06T22:51:41.205 INFO:teuthology.orchestra.run.smithi051.stdout: mon osdmap full prune txsize = 2 2021-02-06T22:51:41.205 INFO:teuthology.orchestra.run.smithi051.stdout: mon scrub inject crc mismatch = 0.01 2021-02-06T22:51:41.205 INFO:teuthology.orchestra.run.smithi051.stdout: mon scrub inject missing keys = 0.05 2021-02-06T22:51:41.205 INFO:teuthology.orchestra.run.smithi051.stdout: mon scrub interval = 300 2021-02-06T22:51:41.206 INFO:teuthology.orchestra.run.smithi051.stdout: mon warn on pool no app = False 2021-02-06T22:51:41.206 INFO:teuthology.orchestra.run.smithi051.stdout: paxos service trim min = 5 2021-02-06T22:51:41.206 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:51:41.206 INFO:teuthology.orchestra.run.smithi051.stdout:[client] 2021-02-06T22:51:41.206 INFO:teuthology.orchestra.run.smithi051.stdout: rgw cache enabled = true 2021-02-06T22:51:41.207 INFO:teuthology.orchestra.run.smithi051.stdout: rgw enable ops log = true 2021-02-06T22:51:41.207 INFO:teuthology.orchestra.run.smithi051.stdout: rgw enable usage log = true 2021-02-06T22:51:41.207 INFO:teuthology.orchestra.run.smithi051.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-06T22:51:41.207 INFO:teuthology.orchestra.run.smithi051.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-06T22:51:41.208 INFO:teuthology.orchestra.run.smithi051.stdout:[mon.a] 2021-02-06T22:51:41.208 INFO:teuthology.orchestra.run.smithi051.stdout:[mon.c] 2021-02-06T22:51:41.208 INFO:teuthology.orchestra.run.smithi051.stdout:[mon.b] 2021-02-06T22:51:41.209 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2021-02-06T22:51:41.210 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2021-02-06T22:51:41.210 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-06T22:51:41.210 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2021-02-06T22:51:41.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.211 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2021-02-06T22:51:41.211 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.211 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2021-02-06T22:51:41.211 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.211 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2021-02-06T22:51:41.212 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2021-02-06T22:51:41.212 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.212 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2021-02-06T22:51:41.212 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2021-02-06T22:51:41.213 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-06T22:51:41.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2021-02-06T22:51:41.213 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.213 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2021-02-06T22:51:41.214 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2021-02-06T22:51:41.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.214 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2021-02-06T22:51:41.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2021-02-06T22:51:41.215 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2021-02-06T22:51:41.215 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2021-02-06T22:51:41.215 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2021-02-06T22:51:41.215 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2021-02-06T22:51:41.215 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2021-02-06T22:51:41.216 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2021-02-06T22:51:41.216 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-06T22:51:41.216 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-06T22:51:41.216 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2021-02-06T22:51:41.217 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.217 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-06T22:51:41.217 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.217 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2021-02-06T22:51:41.217 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.218 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2021-02-06T22:51:41.218 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.218 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2021-02-06T22:51:41.218 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2021-02-06T22:51:41.218 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2021-02-06T22:51:41.219 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "[v1:172.21.15.51:6789],[v1:172.21.15.51:6790],[v1:172.21.15.106:6789]" 2021-02-06T22:51:41.219 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-02-06T22:51:41.219 INFO:teuthology.orchestra.run.smithi106.stdout: debug objecter = 20 2021-02-06T22:51:41.219 INFO:teuthology.orchestra.run.smithi106.stdout: debug rados = 20 2021-02-06T22:51:41.219 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2021-02-06T22:51:41.220 INFO:teuthology.orchestra.run.smithi106.stdout: mon election default strategy = 1 2021-02-06T22:51:41.220 INFO:teuthology.orchestra.run.smithi106.stdout: ms bind msgr2 = False 2021-02-06T22:51:41.220 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay max = 1 2021-02-06T22:51:41.220 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay probability = 0.005 2021-02-06T22:51:41.220 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject delay type = mon 2021-02-06T22:51:41.221 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject internal delays = 0.002 2021-02-06T22:51:41.221 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 2500 2021-02-06T22:51:41.221 INFO:teuthology.orchestra.run.smithi106.stdout: ms type = async 2021-02-06T22:51:41.221 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 4c1ae418-80db-4910-bad7-3f0133db4245 2021-02-06T22:51:41.221 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.222 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2021-02-06T22:51:41.222 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2021-02-06T22:51:41.222 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.222 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2021-02-06T22:51:41.222 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2021-02-06T22:51:41.223 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.223 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2021-02-06T22:51:41.223 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2021-02-06T22:51:41.223 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.223 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2021-02-06T22:51:41.224 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2021-02-06T22:51:41.224 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2021-02-06T22:51:41.224 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.224 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2021-02-06T22:51:41.224 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2021-02-06T22:51:41.225 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.225 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2021-02-06T22:51:41.225 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.225 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2021-02-06T22:51:41.225 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.226 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2021-02-06T22:51:41.226 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.226 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2021-02-06T22:51:41.226 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2021-02-06T22:51:41.226 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.227 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2021-02-06T22:51:41.227 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2021-02-06T22:51:41.227 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2021-02-06T22:51:41.227 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore compression algorithm = zstd 2021-02-06T22:51:41.227 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore compression mode = aggressive 2021-02-06T22:51:41.228 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2021-02-06T22:51:41.228 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2021-02-06T22:51:41.228 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2021-02-06T22:51:41.228 INFO:teuthology.orchestra.run.smithi106.stdout: debug filestore = 20 2021-02-06T22:51:41.228 INFO:teuthology.orchestra.run.smithi106.stdout: debug journal = 20 2021-02-06T22:51:41.229 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 20 2021-02-06T22:51:41.229 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 25 2021-02-06T22:51:41.229 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2021-02-06T22:51:41.229 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2021-02-06T22:51:41.229 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2021-02-06T22:51:41.230 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2021-02-06T22:51:41.230 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify cached snaps = True 2021-02-06T22:51:41.230 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify missing on start = True 2021-02-06T22:51:41.230 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2021-02-06T22:51:41.230 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2021-02-06T22:51:41.231 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue = debug_random 2021-02-06T22:51:41.231 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue cut off = debug_random 2021-02-06T22:51:41.231 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.231 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2021-02-06T22:51:41.231 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-02-06T22:51:41.232 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2021-02-06T22:51:41.232 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2021-02-06T22:51:41.232 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2021-02-06T22:51:41.232 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2021-02-06T22:51:41.232 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout: debug monc = 10 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2021-02-06T22:51:41.233 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2021-02-06T22:51:41.234 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2021-02-06T22:51:41.234 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2021-02-06T22:51:41.234 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2021-02-06T22:51:41.234 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2021-02-06T22:51:41.234 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2021-02-06T22:51:41.235 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2021-02-06T22:51:41.235 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2021-02-06T22:51:41.235 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2021-02-06T22:51:41.235 INFO:teuthology.orchestra.run.smithi106.stdout: mon min osdmap epochs = 25 2021-02-06T22:51:41.235 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune interval = 2 2021-02-06T22:51:41.236 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune min = 15 2021-02-06T22:51:41.236 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune txsize = 2 2021-02-06T22:51:41.236 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub inject crc mismatch = 0.01 2021-02-06T22:51:41.236 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub inject missing keys = 0.05 2021-02-06T22:51:41.237 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub interval = 300 2021-02-06T22:51:41.237 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on pool no app = False 2021-02-06T22:51:41.237 INFO:teuthology.orchestra.run.smithi106.stdout: paxos service trim min = 5 2021-02-06T22:51:41.237 INFO:teuthology.orchestra.run.smithi106.stdout: 2021-02-06T22:51:41.237 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2021-02-06T22:51:41.238 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2021-02-06T22:51:41.238 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2021-02-06T22:51:41.238 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2021-02-06T22:51:41.238 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-06T22:51:41.238 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-06T22:51:41.239 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2021-02-06T22:51:41.239 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2021-02-06T22:51:41.239 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2021-02-06T22:51:41.239 INFO:tasks.ceph:Creating admin key on mon.a... 2021-02-06T22:51:41.240 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2021-02-06T22:51:41.292 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-06T22:51:41.292 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:41.293 DEBUG:teuthology.orchestra.run.smithi051:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2021-02-06T22:51:41.307 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:41.307 DEBUG:teuthology.orchestra.run.smithi051:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2021-02-06T22:51:41.361 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:51:41.362 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:41.362 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-06T22:51:41.362 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-06T22:51:41.437 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:51:41.437 DEBUG:teuthology.orchestra.run.smithi051:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:41.492 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:51:41.492 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:41.492 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2021-02-06T22:51:41.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2021-02-06T22:51:41.528 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:51:41.529 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:41.582 INFO:tasks.ceph:Setting up mon nodes... 2021-02-06T22:51:41.583 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-06T22:51:41.583 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2021-02-06T22:51:41.704 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2021-02-06T22:51:41.707 INFO:tasks.ceph:Setting up mds nodes... 2021-02-06T22:51:41.707 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-06T22:51:41.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-02-06T22:51:41.745 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2021-02-06T22:51:41.757 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-06T22:51:41.758 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi051.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2021-02-06T22:51:41.758 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2021-02-06T22:51:41.784 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:41.784 INFO:tasks.ceph:role: osd.0 2021-02-06T22:51:41.785 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:51:41.785 DEBUG:teuthology.orchestra.run.smithi051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-06T22:51:41.857 INFO:teuthology.orchestra.run.smithi051.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:41.857 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:41.858 INFO:teuthology.orchestra.run.smithi051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:41.858 INFO:teuthology.orchestra.run.smithi051.stdout: = reflink=1 2021-02-06T22:51:41.858 INFO:teuthology.orchestra.run.smithi051.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:41.858 INFO:teuthology.orchestra.run.smithi051.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:41.859 INFO:teuthology.orchestra.run.smithi051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:41.859 INFO:teuthology.orchestra.run.smithi051.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:41.859 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:41.859 INFO:teuthology.orchestra.run.smithi051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:42.233 INFO:teuthology.orchestra.run.smithi051.stdout:Discarding blocks...Done. 2021-02-06T22:51:42.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi051.front.sepia.ceph.com -o noatime 2021-02-06T22:51:42.235 DEBUG:teuthology.orchestra.run.smithi051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2021-02-06T22:51:42.359 DEBUG:teuthology.orchestra.run.smithi051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2021-02-06T22:51:42.390 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2021-02-06T22:51:42.457 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:42.457 INFO:tasks.ceph:role: osd.1 2021-02-06T22:51:42.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:51:42.458 DEBUG:teuthology.orchestra.run.smithi051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-06T22:51:42.531 INFO:teuthology.orchestra.run.smithi051.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:42.531 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:42.532 INFO:teuthology.orchestra.run.smithi051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:42.532 INFO:teuthology.orchestra.run.smithi051.stdout: = reflink=1 2021-02-06T22:51:42.532 INFO:teuthology.orchestra.run.smithi051.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:42.533 INFO:teuthology.orchestra.run.smithi051.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:42.533 INFO:teuthology.orchestra.run.smithi051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:42.533 INFO:teuthology.orchestra.run.smithi051.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:42.533 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:42.534 INFO:teuthology.orchestra.run.smithi051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:42.942 INFO:teuthology.orchestra.run.smithi051.stdout:Discarding blocks...Done. 2021-02-06T22:51:42.943 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi051.front.sepia.ceph.com -o noatime 2021-02-06T22:51:42.944 DEBUG:teuthology.orchestra.run.smithi051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2021-02-06T22:51:43.071 DEBUG:teuthology.orchestra.run.smithi051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2021-02-06T22:51:43.103 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2021-02-06T22:51:43.170 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:43.171 INFO:tasks.ceph:role: osd.2 2021-02-06T22:51:43.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:51:43.172 DEBUG:teuthology.orchestra.run.smithi051:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-06T22:51:43.246 INFO:teuthology.orchestra.run.smithi051.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:43.247 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:43.247 INFO:teuthology.orchestra.run.smithi051.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:43.247 INFO:teuthology.orchestra.run.smithi051.stdout: = reflink=1 2021-02-06T22:51:43.247 INFO:teuthology.orchestra.run.smithi051.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:43.248 INFO:teuthology.orchestra.run.smithi051.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:43.248 INFO:teuthology.orchestra.run.smithi051.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:43.248 INFO:teuthology.orchestra.run.smithi051.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:43.248 INFO:teuthology.orchestra.run.smithi051.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:43.248 INFO:teuthology.orchestra.run.smithi051.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:43.692 INFO:teuthology.orchestra.run.smithi051.stdout:Discarding blocks...Done. 2021-02-06T22:51:43.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi051.front.sepia.ceph.com -o noatime 2021-02-06T22:51:43.694 DEBUG:teuthology.orchestra.run.smithi051:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2021-02-06T22:51:43.817 DEBUG:teuthology.orchestra.run.smithi051:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2021-02-06T22:51:43.848 DEBUG:teuthology.orchestra.run.smithi051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:43.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.959+0000 7f8bbbb71200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2021-02-06T22:51:43.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.960+0000 7f8bbbb71200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2021-02-06T22:51:43.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.960+0000 7f8bbbb71200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-06T22:51:43.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.960+0000 7f8bbbb71200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-06T22:51:43.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.960+0000 7f8bbbb71200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2021-02-06T22:51:43.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:43.965+0000 7f8bbbb71200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2021-02-06T22:51:46.820 DEBUG:teuthology.orchestra.run.smithi051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-02-06T22:51:46.851 DEBUG:teuthology.orchestra.run.smithi051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:46.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.937+0000 7fea79df5200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2021-02-06T22:51:46.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.938+0000 7fea79df5200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2021-02-06T22:51:46.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.938+0000 7fea79df5200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-06T22:51:46.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.938+0000 7fea79df5200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-06T22:51:46.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.938+0000 7fea79df5200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2021-02-06T22:51:46.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:46.938+0000 7fea79df5200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2021-02-06T22:51:49.786 DEBUG:teuthology.orchestra.run.smithi051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-02-06T22:51:49.817 DEBUG:teuthology.orchestra.run.smithi051:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:49.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.906+0000 7f33e392b200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2021-02-06T22:51:49.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.906+0000 7f33e392b200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2021-02-06T22:51:49.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.906+0000 7f33e392b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-06T22:51:49.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.906+0000 7f33e392b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-06T22:51:49.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.906+0000 7f33e392b200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2021-02-06T22:51:49.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:51:49.907+0000 7f33e392b200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2021-02-06T22:51:52.771 DEBUG:teuthology.orchestra.run.smithi051:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-02-06T22:51:52.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2021-02-06T22:51:52.831 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:52.832 INFO:tasks.ceph:role: osd.3 2021-02-06T22:51:52.832 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:51:52.832 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-06T22:51:52.907 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:52.907 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:52.907 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:52.908 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2021-02-06T22:51:52.908 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:52.908 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:52.908 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:52.908 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:52.909 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:52.909 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:53.273 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2021-02-06T22:51:53.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-02-06T22:51:53.275 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2021-02-06T22:51:53.405 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2021-02-06T22:51:53.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2021-02-06T22:51:53.503 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:53.503 INFO:tasks.ceph:role: osd.4 2021-02-06T22:51:53.504 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:51:53.504 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-06T22:51:53.576 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:53.576 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2021-02-06T22:51:53.577 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:53.577 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:53.577 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:53.578 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:53.578 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:53.578 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:53.932 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2021-02-06T22:51:53.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-02-06T22:51:53.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2021-02-06T22:51:54.021 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2021-02-06T22:51:54.050 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2021-02-06T22:51:54.115 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2021-02-06T22:51:54.115 INFO:tasks.ceph:role: osd.5 2021-02-06T22:51:54.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:51:54.116 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-06T22:51:54.187 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-02-06T22:51:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-06T22:51:54.187 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-02-06T22:51:54.188 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 2021-02-06T22:51:54.188 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-02-06T22:51:54.188 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2021-02-06T22:51:54.188 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-02-06T22:51:54.188 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-02-06T22:51:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-06T22:51:54.189 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-06T22:51:54.550 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2021-02-06T22:51:54.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2021-02-06T22:51:54.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2021-02-06T22:51:54.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2021-02-06T22:51:54.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:54.778 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.779+0000 7faffa320200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2021-02-06T22:51:54.780 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.780+0000 7faffa320200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2021-02-06T22:51:54.780 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.780+0000 7faffa320200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-06T22:51:54.780 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.780+0000 7faffa320200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-06T22:51:54.781 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.780+0000 7faffa320200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2021-02-06T22:51:54.783 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:54.784+0000 7faffa320200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2021-02-06T22:51:57.626 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-02-06T22:51:57.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:51:57.742 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.742+0000 7f32bcfd3200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2021-02-06T22:51:57.742 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.742+0000 7f32bcfd3200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2021-02-06T22:51:57.742 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.742+0000 7f32bcfd3200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-06T22:51:57.742 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.742+0000 7f32bcfd3200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-06T22:51:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.742+0000 7f32bcfd3200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2021-02-06T22:51:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:51:57.743+0000 7f32bcfd3200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2021-02-06T22:52:00.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-02-06T22:52:00.622 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:52:00.712 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.712+0000 7fc3f9f39200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2021-02-06T22:52:00.713 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.713+0000 7fc3f9f39200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2021-02-06T22:52:00.713 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.713+0000 7fc3f9f39200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-06T22:52:00.713 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.713+0000 7fc3f9f39200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-06T22:52:00.713 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.713+0000 7fc3f9f39200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2021-02-06T22:52:00.714 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:00.713+0000 7fc3f9f39200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2021-02-06T22:52:03.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-02-06T22:52:03.598 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-06T22:52:03.598 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:03.599 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2021-02-06T22:52:03.629 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:03.630 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2021-02-06T22:52:03.700 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:03.700 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2021-02-06T22:52:03.768 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:03.769 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2021-02-06T22:52:03.798 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:03.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2021-02-06T22:52:03.866 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:03.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2021-02-06T22:52:03.932 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:03.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2021-02-06T22:52:03.998 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:03.998 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2021-02-06T22:52:04.053 INFO:tasks.ceph:Adding keys to all mons... 2021-02-06T22:52:04.053 DEBUG:teuthology.orchestra.run.smithi051:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-06T22:52:04.056 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2021-02-06T22:52:04.096 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.0] 2021-02-06T22:52:04.096 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQB/HR9g01VNORAAiO/VNSlCsbsGS4rPMPzrFQ== 2021-02-06T22:52:04.097 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.1] 2021-02-06T22:52:04.097 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQCCHR9gnrIAOBAAQxM4zYEXJWYJWSVhhcwfoQ== 2021-02-06T22:52:04.097 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.2] 2021-02-06T22:52:04.097 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQCFHR9g4dggNhAArGe0BlI0TAT2ZAD13qTw/A== 2021-02-06T22:52:04.098 INFO:teuthology.orchestra.run.smithi051.stdout:[mgr.x] 2021-02-06T22:52:04.098 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQB9HR9gqn0aKhAAVHXzVrsa6DGf0prBtuWCEw== 2021-02-06T22:52:04.098 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.3] 2021-02-06T22:52:04.098 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQCKHR9gkKV+LhAA50fmHUD1L4Jv8A3ukVPGbQ== 2021-02-06T22:52:04.098 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.4] 2021-02-06T22:52:04.099 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQCNHR9gn+JOLBAAc878vMMceHjB9zVv4/OfAg== 2021-02-06T22:52:04.099 INFO:teuthology.orchestra.run.smithi051.stdout:[osd.5] 2021-02-06T22:52:04.099 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQCQHR9gCGSNKhAAUhZiDy47vFc8SKzWK2nwHA== 2021-02-06T22:52:04.099 INFO:teuthology.orchestra.run.smithi051.stdout:[client.0] 2021-02-06T22:52:04.099 INFO:teuthology.orchestra.run.smithi051.stdout: key = AQB9HR9gsO2BLBAAKLlAnpZJxg8sAXm1SdFk+g== 2021-02-06T22:52:04.117 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2021-02-06T22:52:04.118 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB/HR9g01VNORAAiO/VNSlCsbsGS4rPMPzrFQ== 2021-02-06T22:52:04.118 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2021-02-06T22:52:04.118 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCCHR9gnrIAOBAAQxM4zYEXJWYJWSVhhcwfoQ== 2021-02-06T22:52:04.118 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2021-02-06T22:52:04.119 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCFHR9g4dggNhAArGe0BlI0TAT2ZAD13qTw/A== 2021-02-06T22:52:04.119 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2021-02-06T22:52:04.119 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB9HR9gqn0aKhAAVHXzVrsa6DGf0prBtuWCEw== 2021-02-06T22:52:04.119 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2021-02-06T22:52:04.119 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCKHR9gkKV+LhAA50fmHUD1L4Jv8A3ukVPGbQ== 2021-02-06T22:52:04.120 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2021-02-06T22:52:04.120 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCNHR9gn+JOLBAAc878vMMceHjB9zVv4/OfAg== 2021-02-06T22:52:04.120 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2021-02-06T22:52:04.120 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQCQHR9gCGSNKhAAUhZiDy47vFc8SKzWK2nwHA== 2021-02-06T22:52:04.120 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2021-02-06T22:52:04.121 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQB9HR9gsO2BLBAAKLlAnpZJxg8sAXm1SdFk+g== 2021-02-06T22:52:04.121 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.143 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.209 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.260 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.262 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.309 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-06T22:52:04.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-06T22:52:04.357 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.359 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.405 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.407 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.453 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-06T22:52:04.502 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-06T22:52:04.505 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-06T22:52:04.556 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-06T22:52:04.557 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2021-02-06T22:52:04.582 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-06T22:52:04.674 DEBUG:teuthology.orchestra.run.smithi051:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2021-02-06T22:52:04.700 DEBUG:teuthology.orchestra.run.smithi051:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2021-02-06T22:52:04.765 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-06T22:52:04.858 DEBUG:teuthology.orchestra.run.smithi051:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2021-02-06T22:52:04.884 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2021-02-06T22:52:04.909 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2021-02-06T22:52:05.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2021-02-06T22:52:05.029 DEBUG:teuthology.orchestra.run.smithi051:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:52:05.031 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2021-02-06T22:52:05.083 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2021-02-06T22:52:05.084 INFO:tasks.ceph.mon.a:Restarting daemon 2021-02-06T22:52:05.084 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2021-02-06T22:52:05.087 INFO:tasks.ceph.mon.a:Started 2021-02-06T22:52:05.087 INFO:tasks.ceph.mon.c:Restarting daemon 2021-02-06T22:52:05.088 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2021-02-06T22:52:05.090 INFO:tasks.ceph.mon.c:Started 2021-02-06T22:52:05.090 INFO:tasks.ceph.mon.b:Restarting daemon 2021-02-06T22:52:05.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2021-02-06T22:52:05.125 INFO:tasks.ceph.mon.b:Started 2021-02-06T22:52:05.126 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2021-02-06T22:52:05.127 INFO:tasks.ceph.mgr.x:Restarting daemon 2021-02-06T22:52:05.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2021-02-06T22:52:05.129 INFO:tasks.ceph.mgr.x:Started 2021-02-06T22:52:05.129 INFO:tasks.ceph:Setting crush tunables to default 2021-02-06T22:52:05.130 DEBUG:teuthology.orchestra.run.smithi051:> sudo ceph --cluster ceph osd crush tunables default 2021-02-06T22:52:05.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.253+0000 7f7d25d15700 1 Processor -- start 2021-02-06T22:52:05.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d25d15700 1 -- start start 2021-02-06T22:52:05.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d25d15700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d20067c20 con 0x7f7d20067220 2021-02-06T22:52:05.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d25d15700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d20099480 con 0x7f7d20066d70 2021-02-06T22:52:05.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d25d15700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d20063360 con 0x7f7d20067840 2021-02-06T22:52:05.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d1f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f7d20067840 0x7f7d20127220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59398/0 (socket says 172.21.15.51:59398) 2021-02-06T22:52:05.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d1f7fe700 1 -- 172.21.15.51:0/3834005926 learned_addr learned my addr 172.21.15.51:0/3834005926 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:05.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.254+0000 7f7d1ffff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f7d20067220 0x7f7d20132f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59056/0 (socket says 172.21.15.51:59056) 2021-02-06T22:52:05.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.256+0000 7f7d1f7fe700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6790/0 conn(0x7f7d20067840 legacy=0x7f7d20127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:05.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.256+0000 7f7d1ffff700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6789/0 conn(0x7f7d20067220 legacy=0x7f7d20132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:05.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:05.257+0000 7f7d1effd700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.106:6789/0 conn(0x7f7d20066d70 legacy=0x7f7d2012f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:08.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6790/0 conn(0x7f7d20067840 legacy=0x7f7d20127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:08.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.106:6789/0 conn(0x7f7d20066d70 legacy=0x7f7d2012f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:08.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6789/0 conn(0x7f7d20067220 legacy=0x7f7d20132f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:08.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d20063600 con 0x7f7d0000af30 2021-02-06T22:52:08.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0000fc20 con 0x7f7d00003540 2021-02-06T22:52:08.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.254+0000 7f7d1d7fa700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d00010e10 con 0x7f7d00007200 2021-02-06T22:52:08.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.257+0000 7f7d1effd700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6790/0 conn(0x7f7d00007200 legacy=0x7f7d00009690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:08.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.257+0000 7f7d1ffff700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6789/0 conn(0x7f7d0000af30 legacy=0x7f7d0000d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:08.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:08.257+0000 7f7d1f7fe700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.106:6789/0 conn(0x7f7d00003540 legacy=0x7f7d00005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:10.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.439+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879943480 0 0) 0x7f7d20063600 con 0x7f7d0000af30 2021-02-06T22:52:10.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.439+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d0c003230 con 0x7f7d0000af30 2021-02-06T22:52:10.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109932981 0 0) 0x7f7d0000fc20 con 0x7f7d00003540 2021-02-06T22:52:10.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d20063600 con 0x7f7d00003540 2021-02-06T22:52:10.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3142154052 0 0) 0x7f7d20063600 con 0x7f7d00003540 2021-02-06T22:52:10.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6790/0 conn(0x7f7d00007200 legacy=0x7f7d00009690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.51:6789/0 conn(0x7f7d0000af30 legacy=0x7f7d0000d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000120e0 con 0x7f7d00003540 2021-02-06T22:52:10.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7d10001900 con 0x7f7d00003540 2021-02-06T22:52:10.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7d10001be0 con 0x7f7d00003540 2021-02-06T22:52:10.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.440+0000 7f7d1e7fc700 1 -- 172.21.15.51:0/3834005926 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7d10004750 con 0x7f7d00003540 2021-02-06T22:52:10.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.441+0000 7f7d25d15700 1 -- 172.21.15.51:0/3834005926 >> v1:172.21.15.106:6789/0 conn(0x7f7d00003540 legacy=0x7f7d00005990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.441+0000 7f7d25d15700 1 -- 172.21.15.51:0/3834005926 shutdown_connections 2021-02-06T22:52:10.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.441+0000 7f7d25d15700 1 -- 172.21.15.51:0/3834005926 >> 172.21.15.51:0/3834005926 conn(0x7f7d20099770 msgr2=0x7f7d20099b80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:10.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.441+0000 7f7d25d15700 1 -- 172.21.15.51:0/3834005926 shutdown_connections 2021-02-06T22:52:10.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.441+0000 7f7d25d15700 1 -- 172.21.15.51:0/3834005926 wait complete. 2021-02-06T22:52:10.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.442+0000 7f7d25d15700 1 librados: starting msgr at 2021-02-06T22:52:10.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.442+0000 7f7d25d15700 1 librados: starting objecter 2021-02-06T22:52:10.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 Processor -- start 2021-02-06T22:52:10.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 -- start start 2021-02-06T22:52:10.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 librados: setting wanted keys 2021-02-06T22:52:10.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 librados: calling monclient init 2021-02-06T22:52:10.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d20098a00 con 0x7f7d00007200 2021-02-06T22:52:10.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d201132b0 con 0x7f7d0000af30 2021-02-06T22:52:10.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d25d15700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d201128b0 con 0x7f7d00003540 2021-02-06T22:52:10.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d1effd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f7d00007200 0x7f7d20125ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59078/0 (socket says 172.21.15.51:59078) 2021-02-06T22:52:10.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.443+0000 7f7d1effd700 1 -- 172.21.15.51:0/50892896 learned_addr learned my addr 172.21.15.51:0/50892896 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:10.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d1effd700 1 -- 172.21.15.51:0/50892896 >> v1:172.21.15.51:6789/0 conn(0x7f7d00007200 legacy=0x7f7d20125ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:10.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 10 client.?.objecter ms_handle_connect 0x7f7d00007200 2021-02-06T22:52:10.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:10.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363716550 0 0) 0x7f7d20098a00 con 0x7f7d00007200 2021-02-06T22:52:10.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d0000f5e0 con 0x7f7d00007200 2021-02-06T22:52:10.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2363267399 0 0) 0x7f7d0000f5e0 con 0x7f7d00007200 2021-02-06T22:52:10.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7d20098a00 con 0x7f7d00007200 2021-02-06T22:52:10.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7d14001a20 con 0x7f7d00007200 2021-02-06T22:52:10.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4024693248 0 0) 0x7f7d20098a00 con 0x7f7d00007200 2021-02-06T22:52:10.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 >> v1:172.21.15.51:6790/0 conn(0x7f7d00003540 legacy=0x7f7d2012db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 >> v1:172.21.15.106:6789/0 conn(0x7f7d0000af30 legacy=0x7f7d20141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d201146e0 con 0x7f7d00007200 2021-02-06T22:52:10.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d20126600 con 0x7f7d00007200 2021-02-06T22:52:10.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d25d15700 10 client.4107.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:10.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d20111c70 con 0x7f7d00007200 2021-02-06T22:52:10.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.446+0000 7f7d25d15700 1 librados: init done 2021-02-06T22:52:10.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.447+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7d140021f0 con 0x7f7d00007200 2021-02-06T22:52:10.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.447+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7d14002500 con 0x7f7d00007200 2021-02-06T22:52:10.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.447+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7f7d140028b0 con 0x7f7d00007200 2021-02-06T22:52:10.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc004d60 con 0x7f7d00007200 2021-02-06T22:52:10.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (unknown 124449686 0 0) 0x7f7d14005d40 con 0x7f7d00007200 2021-02-06T22:52:10.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d077fe700 10 client.4107.objecter ms_dispatch 0x7f7d20001510 osd_map(1..1 src has 1..1) v4 2021-02-06T22:52:10.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d077fe700 3 client.4107.objecter handle_osd_map got epochs [1,1] > 0 2021-02-06T22:52:10.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d077fe700 3 client.4107.objecter handle_osd_map decoding full epoch 1 2021-02-06T22:52:10.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.448+0000 7f7d077fe700 20 client.4107.objecter dump_active .. 0 homeless 2021-02-06T22:52:10.454 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.450+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7f7d140178e0 con 0x7f7d00007200 2021-02-06T22:52:10.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.537+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7cfc005430 con 0x7f7d00007200 2021-02-06T22:52:10.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.539+0000 7f7d077fe700 1 -- 172.21.15.51:0/50892896 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (unknown 2277712955 0 0) 0x7f7d14006000 con 0x7f7d00007200 2021-02-06T22:52:10.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 10 librados: watch_flush enter 2021-02-06T22:52:10.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 10 librados: watch_flush exit 2021-02-06T22:52:10.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 20 client.4107.objecter shutdown clearing up homeless session... 2021-02-06T22:52:10.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 10 client.4107.objecter successfully canceled tick 2021-02-06T22:52:10.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 >> v1:172.21.15.51:6789/0 conn(0x7f7d00007200 legacy=0x7f7d20125ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:10.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 shutdown_connections 2021-02-06T22:52:10.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.540+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 >> 172.21.15.51:0/50892896 conn(0x7f7d20099770 msgr2=0x7f7d20064bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:10.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.541+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 shutdown_connections 2021-02-06T22:52:10.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.541+0000 7f7d25d15700 1 -- 172.21.15.51:0/50892896 wait complete. 2021-02-06T22:52:10.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:10.541+0000 7f7d25d15700 1 librados: shutdown 2021-02-06T22:52:10.542 INFO:teuthology.orchestra.run.smithi051.stderr:adjusted tunables profile to default 2021-02-06T22:52:10.551 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2021-02-06T22:52:10.552 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:10.552 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2021-02-06T22:52:10.579 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:10.579 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2021-02-06T22:52:10.644 DEBUG:teuthology.orchestra.run.smithi051:> set -ex 2021-02-06T22:52:10.645 DEBUG:teuthology.orchestra.run.smithi051:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2021-02-06T22:52:10.709 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:10.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2021-02-06T22:52:10.734 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:10.735 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2021-02-06T22:52:10.798 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2021-02-06T22:52:10.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2021-02-06T22:52:10.863 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new f225cc02-dcef-4a50-b04e-8cf67896e638 0 2021-02-06T22:52:11.020 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.020+0000 7f337c260700 1 Processor -- start 2021-02-06T22:52:11.020 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337c260700 1 -- start start 2021-02-06T22:52:11.021 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337c260700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374094500 con 0x7f3374092cc0 2021-02-06T22:52:11.021 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337c260700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374091030 con 0x7f337412ce50 2021-02-06T22:52:11.022 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337c260700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33740912d0 con 0x7f337408f6d0 2021-02-06T22:52:11.022 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337a7fd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f337412ce50 0x7f337412f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39000/0 (socket says 172.21.15.106:39000) 2021-02-06T22:52:11.022 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.021+0000 7f337a7fd700 1 -- 172.21.15.106:0/79640024 learned_addr learned my addr 172.21.15.106:0/79640024 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.023+0000 7f337a7fd700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.106:6789/0 conn(0x7f337412ce50 legacy=0x7f337412f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199833021 0 0) 0x7f3374091030 con 0x7f337412ce50 2021-02-06T22:52:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f335c003230 con 0x7f337412ce50 2021-02-06T22:52:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f33797fb700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.51:6789/0 conn(0x7f3374092cc0 legacy=0x7f3374093170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3379ffc700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.51:6790/0 conn(0x7f337408f6d0 legacy=0x7f3374093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758788445 0 0) 0x7f3374094500 con 0x7f3374092cc0 2021-02-06T22:52:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374091030 con 0x7f3374092cc0 2021-02-06T22:52:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153799554 0 0) 0x7f33740912d0 con 0x7f337408f6d0 2021-02-06T22:52:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374094500 con 0x7f337408f6d0 2021-02-06T22:52:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4201430915 0 0) 0x7f335c003230 con 0x7f337412ce50 2021-02-06T22:52:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.51:6790/0 conn(0x7f337408f6d0 legacy=0x7f3374093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.51:6789/0 conn(0x7f3374092cc0 legacy=0x7f3374093170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374091570 con 0x7f337412ce50 2021-02-06T22:52:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f336c001cf0 con 0x7f337412ce50 2021-02-06T22:52:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f336c001f10 con 0x7f337412ce50 2021-02-06T22:52:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.024+0000 7f3378ffa700 1 -- 172.21.15.106:0/79640024 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f336c004930 con 0x7f337412ce50 2021-02-06T22:52:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 -- 172.21.15.106:0/79640024 >> v1:172.21.15.106:6789/0 conn(0x7f337412ce50 legacy=0x7f337412f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 -- 172.21.15.106:0/79640024 shutdown_connections 2021-02-06T22:52:11.029 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 -- 172.21.15.106:0/79640024 >> 172.21.15.106:0/79640024 conn(0x7f3374095fb0 msgr2=0x7f33740963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.029 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 -- 172.21.15.106:0/79640024 shutdown_connections 2021-02-06T22:52:11.029 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 -- 172.21.15.106:0/79640024 wait complete. 2021-02-06T22:52:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 librados: starting msgr at 2021-02-06T22:52:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 librados: starting objecter 2021-02-06T22:52:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.025+0000 7f337c260700 1 Processor -- start 2021-02-06T22:52:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 -- start start 2021-02-06T22:52:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 librados: setting wanted keys 2021-02-06T22:52:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 librados: calling monclient init 2021-02-06T22:52:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f337412cac0 con 0x7f337412ce50 2021-02-06T22:52:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374116b20 con 0x7f337408f6d0 2021-02-06T22:52:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f337c260700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3374116dc0 con 0x7f3374092cc0 2021-02-06T22:52:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f3379ffc700 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f337408f6d0 legacy=0x7f337412c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-06T22:52:11.035 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f3379ffc700 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f337408f6d0 legacy=0x7f337412c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:52:11.035 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f3379ffc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f337408f6d0 0x7f337412c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2021-02-06T22:52:11.035 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f3379ffc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f337408f6d0 0x7f337412c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-06T22:52:11.035 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f33797fb700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3374092cc0 0x7f3374132750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.106:43878/0 (socket says 172.21.15.106:43878) 2021-02-06T22:52:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.026+0000 7f33797fb700 1 -- 172.21.15.106:0/367801661 learned_addr learned my addr 172.21.15.106:0/367801661 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f33797fb700 1 -- 172.21.15.106:0/367801661 >> v1:172.21.15.51:6790/0 conn(0x7f3374092cc0 legacy=0x7f3374132750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 10 client.?.objecter ms_handle_connect 0x7f3374092cc0 2021-02-06T22:52:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.036 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 10 client.?.objecter ms_handle_connect 0x7f337412ce50 2021-02-06T22:52:11.037 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.037 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f337a7fd700 1 -- 172.21.15.106:0/367801661 >> v1:172.21.15.51:6789/0 conn(0x7f337412ce50 legacy=0x7f337413dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.037 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313768303 0 0) 0x7f3374116dc0 con 0x7f3374092cc0 2021-02-06T22:52:11.037 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3354004bd0 con 0x7f3374092cc0 2021-02-06T22:52:11.037 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791221797 0 0) 0x7f337412cac0 con 0x7f337412ce50 2021-02-06T22:52:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.028+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374116dc0 con 0x7f337412ce50 2021-02-06T22:52:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2264633867 0 0) 0x7f3354004bd0 con 0x7f3374092cc0 2021-02-06T22:52:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f337412cac0 con 0x7f3374092cc0 2021-02-06T22:52:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3370001cb0 con 0x7f3374092cc0 2021-02-06T22:52:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1931581301 0 0) 0x7f3374116dc0 con 0x7f337412ce50 2021-02-06T22:52:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3354004bd0 con 0x7f337412ce50 2021-02-06T22:52:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f336c004870 con 0x7f337412ce50 2021-02-06T22:52:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1074034939 0 0) 0x7f337412cac0 con 0x7f3374092cc0 2021-02-06T22:52:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 >> v1:172.21.15.106:6789/0 conn(0x7f337408f6d0 legacy=0x7f337412c3b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:52:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 >> v1:172.21.15.51:6789/0 conn(0x7f337412ce50 legacy=0x7f337413dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3374132e60 con 0x7f3374092cc0 2021-02-06T22:52:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33741158f0 con 0x7f3374092cc0 2021-02-06T22:52:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3370002400 con 0x7f3374092cc0 2021-02-06T22:52:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3370002710 con 0x7f3374092cc0 2021-02-06T22:52:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7f3370002b40 con 0x7f3374092cc0 2021-02-06T22:52:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f337c260700 10 client.4103.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3374114250 con 0x7f3374092cc0 2021-02-06T22:52:11.042 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f337c260700 1 librados: init done 2021-02-06T22:52:11.042 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (unknown 1099527010 0 0) 0x7f3370005d30 con 0x7f3374092cc0 2021-02-06T22:52:11.042 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 10 client.4103.objecter ms_dispatch 0x7f3374001510 osd_map(2..2 src has 1..2) v4 2021-02-06T22:52:11.042 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 3 client.4103.objecter handle_osd_map got epochs [2,2] > 0 2021-02-06T22:52:11.042 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 3 client.4103.objecter handle_osd_map decoding full epoch 2 2021-02-06T22:52:11.043 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.029+0000 7f3361ffb700 20 client.4103.objecter dump_active .. 0 homeless 2021-02-06T22:52:11.043 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.030+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33740581b0 con 0x7f3374092cc0 2021-02-06T22:52:11.043 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.032+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7f3370006020 con 0x7f3374092cc0 2021-02-06T22:52:11.122 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.123+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd new", "uuid": "f225cc02-dcef-4a50-b04e-8cf67896e638", "id": 0} v 0) v1 -- 0x7f337405db20 con 0x7f3374092cc0 2021-02-06T22:52:11.137 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.138+0000 7f3361ffb700 1 -- 172.21.15.106:0/367801661 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f225cc02-dcef-4a50-b04e-8cf67896e638", "id": 0}]=0 v3) v1 ==== 112+0+2 (unknown 2328932349 0 732707515) 0x7f3370006320 con 0x7f3374092cc0 2021-02-06T22:52:11.138 INFO:teuthology.orchestra.run.smithi106.stdout:0 2021-02-06T22:52:11.139 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 10 librados: watch_flush enter 2021-02-06T22:52:11.139 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 10 librados: watch_flush exit 2021-02-06T22:52:11.139 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 20 client.4103.objecter shutdown clearing up homeless session... 2021-02-06T22:52:11.139 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 10 client.4103.objecter successfully canceled tick 2021-02-06T22:52:11.140 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 >> v1:172.21.15.51:6790/0 conn(0x7f3374092cc0 legacy=0x7f3374132750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.140 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 shutdown_connections 2021-02-06T22:52:11.140 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 >> 172.21.15.106:0/367801661 conn(0x7f3374095fb0 msgr2=0x7f3374064d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.140 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 shutdown_connections 2021-02-06T22:52:11.141 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 -- 172.21.15.106:0/367801661 wait complete. 2021-02-06T22:52:11.141 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.139+0000 7f337c260700 1 librados: shutdown 2021-02-06T22:52:11.149 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 334a242d-eed9-4d1d-82b0-d0835911d4ac 1 2021-02-06T22:52:11.267 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.267+0000 7fe26b0fe700 1 Processor -- start 2021-02-06T22:52:11.268 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.267+0000 7fe26b0fe700 1 -- start start 2021-02-06T22:52:11.268 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.268+0000 7fe26b0fe700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264094bc0 con 0x7fe264097680 2021-02-06T22:52:11.268 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.268+0000 7fe26b0fe700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264127a10 con 0x7fe264093e80 2021-02-06T22:52:11.268 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.268+0000 7fe26b0fe700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264097ad0 con 0x7fe264097200 2021-02-06T22:52:11.268 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.268+0000 7fe268e9a700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe264093e80 0x7fe264127300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39010/0 (socket says 172.21.15.106:39010) 2021-02-06T22:52:11.269 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.268+0000 7fe268e9a700 1 -- 172.21.15.106:0/1653379018 learned_addr learned my addr 172.21.15.106:0/1653379018 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.271 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe268e9a700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.106:6789/0 conn(0x7fe264093e80 legacy=0x7fe264127300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.271 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe26969b700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.51:6789/0 conn(0x7fe264097680 legacy=0x7fe264133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.272 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe263fff700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.51:6790/0 conn(0x7fe264097200 legacy=0x7fe26412fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.272 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435438429 0 0) 0x7fe264094bc0 con 0x7fe264097680 2021-02-06T22:52:11.272 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe248003230 con 0x7fe264097680 2021-02-06T22:52:11.272 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373664676 0 0) 0x7fe264097ad0 con 0x7fe264097200 2021-02-06T22:52:11.273 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.270+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264094bc0 con 0x7fe264097200 2021-02-06T22:52:11.273 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 390391236 0 0) 0x7fe264094bc0 con 0x7fe264097200 2021-02-06T22:52:11.273 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.106:6789/0 conn(0x7fe264093e80 legacy=0x7fe264127300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.273 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.51:6789/0 conn(0x7fe264097680 legacy=0x7fe264133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.273 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264099bb0 con 0x7fe264097200 2021-02-06T22:52:11.274 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe250001a40 con 0x7fe264097200 2021-02-06T22:52:11.274 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe250001c30 con 0x7fe264097200 2021-02-06T22:52:11.274 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe2637fe700 1 -- 172.21.15.106:0/1653379018 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe250002060 con 0x7fe264097200 2021-02-06T22:52:11.274 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe26b0fe700 1 -- 172.21.15.106:0/1653379018 >> v1:172.21.15.51:6790/0 conn(0x7fe264097200 legacy=0x7fe26412fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.274 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe26b0fe700 1 -- 172.21.15.106:0/1653379018 shutdown_connections 2021-02-06T22:52:11.275 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe26b0fe700 1 -- 172.21.15.106:0/1653379018 >> 172.21.15.106:0/1653379018 conn(0x7fe26409d680 msgr2=0x7fe26409da90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.275 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe26b0fe700 1 -- 172.21.15.106:0/1653379018 shutdown_connections 2021-02-06T22:52:11.275 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.271+0000 7fe26b0fe700 1 -- 172.21.15.106:0/1653379018 wait complete. 2021-02-06T22:52:11.275 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 librados: starting msgr at 2021-02-06T22:52:11.275 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 librados: starting objecter 2021-02-06T22:52:11.276 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 Processor -- start 2021-02-06T22:52:11.279 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 -- start start 2021-02-06T22:52:11.279 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 librados: setting wanted keys 2021-02-06T22:52:11.280 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.272+0000 7fe26b0fe700 1 librados: calling monclient init 2021-02-06T22:52:11.280 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.273+0000 7fe26b0fe700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264096ce0 con 0x7fe264097680 2021-02-06T22:52:11.280 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.273+0000 7fe26b0fe700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264065b20 con 0x7fe264097200 2021-02-06T22:52:11.280 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.273+0000 7fe26b0fe700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe264066560 con 0x7fe264093e80 2021-02-06T22:52:11.281 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.273+0000 7fe263fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe264097200 0x7fe26413ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39018/0 (socket says 172.21.15.106:39018) 2021-02-06T22:52:11.281 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.273+0000 7fe263fff700 1 -- 172.21.15.106:0/729246107 learned_addr learned my addr 172.21.15.106:0/729246107 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.281 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe263fff700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.106:6789/0 conn(0x7fe264097200 legacy=0x7fe26413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.281 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter ms_handle_connect 0x7fe264097200 2021-02-06T22:52:11.282 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.282 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter ms_handle_connect 0x7fe264093e80 2021-02-06T22:52:11.282 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.282 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter ms_handle_connect 0x7fe264097680 2021-02-06T22:52:11.282 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.283 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe268e9a700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.51:6790/0 conn(0x7fe264093e80 legacy=0x7fe264066920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.283 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe26969b700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.51:6789/0 conn(0x7fe264097680 legacy=0x7fe2641421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.283 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492483144 0 0) 0x7fe264065b20 con 0x7fe264097200 2021-02-06T22:52:11.283 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe244004bd0 con 0x7fe264097200 2021-02-06T22:52:11.283 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760037951 0 0) 0x7fe264066560 con 0x7fe264093e80 2021-02-06T22:52:11.284 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264065b20 con 0x7fe264093e80 2021-02-06T22:52:11.284 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495850491 0 0) 0x7fe264096ce0 con 0x7fe264097680 2021-02-06T22:52:11.284 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264066560 con 0x7fe264097680 2021-02-06T22:52:11.284 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2761420761 0 0) 0x7fe244004bd0 con 0x7fe264097200 2021-02-06T22:52:11.285 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe264096ce0 con 0x7fe264097200 2021-02-06T22:52:11.285 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe250001a00 con 0x7fe264097200 2021-02-06T22:52:11.285 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.275+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 403903976 0 0) 0x7fe264065b20 con 0x7fe264093e80 2021-02-06T22:52:11.285 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe244004bd0 con 0x7fe264093e80 2021-02-06T22:52:11.285 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2580019d0 con 0x7fe264093e80 2021-02-06T22:52:11.286 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2776580517 0 0) 0x7fe264096ce0 con 0x7fe264097200 2021-02-06T22:52:11.286 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.51:6790/0 conn(0x7fe264093e80 legacy=0x7fe264066920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.286 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.51:6789/0 conn(0x7fe264097680 legacy=0x7fe2641421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.286 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264118b40 con 0x7fe264097200 2021-02-06T22:52:11.286 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe264064ef0 con 0x7fe264097200 2021-02-06T22:52:11.287 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe26b0fe700 10 client.4108.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:11.287 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe264118030 con 0x7fe264097200 2021-02-06T22:52:11.287 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe26b0fe700 1 librados: init done 2021-02-06T22:52:11.287 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe250002040 con 0x7fe264097200 2021-02-06T22:52:11.287 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe250002b90 con 0x7fe264097200 2021-02-06T22:52:11.288 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7fe250005720 con 0x7fe264097200 2021-02-06T22:52:11.288 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (unknown 2895452833 0 0) 0x7fe250006260 con 0x7fe264097200 2021-02-06T22:52:11.288 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 10 client.4108.objecter ms_dispatch 0x7fe264001510 osd_map(3..3 src has 1..3) v4 2021-02-06T22:52:11.288 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 3 client.4108.objecter handle_osd_map got epochs [3,3] > 0 2021-02-06T22:52:11.289 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 3 client.4108.objecter handle_osd_map decoding full epoch 3 2021-02-06T22:52:11.289 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe260ff9700 20 client.4108.objecter dump_active .. 0 homeless 2021-02-06T22:52:11.289 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.276+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c004d60 con 0x7fe264097200 2021-02-06T22:52:11.289 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.279+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7fe2500059b0 con 0x7fe264097200 2021-02-06T22:52:11.370 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.370+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "334a242d-eed9-4d1d-82b0-d0835911d4ac", "id": 1} v 0) v1 -- 0x7fe23c0059b0 con 0x7fe264097200 2021-02-06T22:52:11.375 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.376+0000 7fe260ff9700 1 -- 172.21.15.106:0/729246107 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "334a242d-eed9-4d1d-82b0-d0835911d4ac", "id": 1}]=0 v4) v1 ==== 112+0+2 (unknown 3907234769 0 940483276) 0x7fe2500064a0 con 0x7fe264097200 2021-02-06T22:52:11.376 INFO:teuthology.orchestra.run.smithi106.stdout:1 2021-02-06T22:52:11.377 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 10 librados: watch_flush enter 2021-02-06T22:52:11.377 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 10 librados: watch_flush exit 2021-02-06T22:52:11.377 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 20 client.4108.objecter shutdown clearing up homeless session... 2021-02-06T22:52:11.378 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 10 client.4108.objecter successfully canceled tick 2021-02-06T22:52:11.378 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 >> v1:172.21.15.106:6789/0 conn(0x7fe264097200 legacy=0x7fe26413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.378 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 shutdown_connections 2021-02-06T22:52:11.378 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 >> 172.21.15.106:0/729246107 conn(0x7fe26409d680 msgr2=0x7fe264095180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.378 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 shutdown_connections 2021-02-06T22:52:11.379 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 -- 172.21.15.106:0/729246107 wait complete. 2021-02-06T22:52:11.379 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.377+0000 7fe26b0fe700 1 librados: shutdown 2021-02-06T22:52:11.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 2c06d214-feb2-47bd-80ab-66827a74337f 2 2021-02-06T22:52:11.517 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.517+0000 7fb44697f700 1 Processor -- start 2021-02-06T22:52:11.517 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.517+0000 7fb44697f700 1 -- start start 2021-02-06T22:52:11.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.518+0000 7fb44697f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440095070 con 0x7fb44008fa00 2021-02-06T22:52:11.518 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.518+0000 7fb44697f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440095310 con 0x7fb44008f550 2021-02-06T22:52:11.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.518+0000 7fb44697f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4400955b0 con 0x7fb4400929c0 2021-02-06T22:52:11.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.518+0000 7fb43f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb44008f550 0x7fb44012d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39022/0 (socket says 172.21.15.106:39022) 2021-02-06T22:52:11.519 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.518+0000 7fb43f7fe700 1 -- 172.21.15.106:0/2145851538 learned_addr learned my addr 172.21.15.106:0/2145851538 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.520 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43f7fe700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.106:6789/0 conn(0x7fb44008f550 legacy=0x7fb44012d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb444f1c700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.51:6789/0 conn(0x7fb44008fa00 legacy=0x7fb440130ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43ffff700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.51:6790/0 conn(0x7fb4400929c0 legacy=0x7fb44008ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660210701 0 0) 0x7fb440095310 con 0x7fb44008f550 2021-02-06T22:52:11.521 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c003230 con 0x7fb44008f550 2021-02-06T22:52:11.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005475756 0 0) 0x7fb440095070 con 0x7fb44008fa00 2021-02-06T22:52:11.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.520+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440095310 con 0x7fb44008fa00 2021-02-06T22:52:11.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 389088711 0 0) 0x7fb42c003230 con 0x7fb44008f550 2021-02-06T22:52:11.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.51:6790/0 conn(0x7fb4400929c0 legacy=0x7fb44008ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.522 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.51:6789/0 conn(0x7fb44008fa00 legacy=0x7fb440130ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400945e0 con 0x7fb44008f550 2021-02-06T22:52:11.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb4300019f0 con 0x7fb44008f550 2021-02-06T22:52:11.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb430001ca0 con 0x7fb44008f550 2021-02-06T22:52:11.523 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb43effd700 1 -- 172.21.15.106:0/2145851538 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb430004750 con 0x7fb44008f550 2021-02-06T22:52:11.527 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.521+0000 7fb44697f700 1 -- 172.21.15.106:0/2145851538 >> v1:172.21.15.106:6789/0 conn(0x7fb44008f550 legacy=0x7fb44012d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.527 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 -- 172.21.15.106:0/2145851538 shutdown_connections 2021-02-06T22:52:11.527 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 -- 172.21.15.106:0/2145851538 >> 172.21.15.106:0/2145851538 conn(0x7fb440095fb0 msgr2=0x7fb4400963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 -- 172.21.15.106:0/2145851538 shutdown_connections 2021-02-06T22:52:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 -- 172.21.15.106:0/2145851538 wait complete. 2021-02-06T22:52:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 librados: starting msgr at 2021-02-06T22:52:11.528 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 librados: starting objecter 2021-02-06T22:52:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.522+0000 7fb44697f700 1 Processor -- start 2021-02-06T22:52:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 -- start start 2021-02-06T22:52:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 librados: setting wanted keys 2021-02-06T22:52:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 librados: calling monclient init 2021-02-06T22:52:11.529 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440067960 con 0x7fb4400929c0 2021-02-06T22:52:11.530 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440067c00 con 0x7fb44008fa00 2021-02-06T22:52:11.530 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb44697f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440067400 con 0x7fb44008f550 2021-02-06T22:52:11.530 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb43f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb44008fa00 0x7fb44013ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39028/0 (socket says 172.21.15.106:39028) 2021-02-06T22:52:11.530 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.523+0000 7fb43f7fe700 1 -- 172.21.15.106:0/519663002 learned_addr learned my addr 172.21.15.106:0/519663002 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.530 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb43f7fe700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.106:6789/0 conn(0x7fb44008fa00 legacy=0x7fb44013ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter ms_handle_connect 0x7fb44008fa00 2021-02-06T22:52:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2779502643 0 0) 0x7fb440067c00 con 0x7fb44008fa00 2021-02-06T22:52:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb420004bd0 con 0x7fb44008fa00 2021-02-06T22:52:11.531 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter ms_handle_connect 0x7fb4400929c0 2021-02-06T22:52:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb444f1c700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.51:6789/0 conn(0x7fb4400929c0 legacy=0x7fb4401423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter ms_handle_connect 0x7fb44008f550 2021-02-06T22:52:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb427fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.532 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.525+0000 7fb43ffff700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.51:6790/0 conn(0x7fb44008f550 legacy=0x7fb440091b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.533 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837255253 0 0) 0x7fb440067960 con 0x7fb4400929c0 2021-02-06T22:52:11.533 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440067c00 con 0x7fb4400929c0 2021-02-06T22:52:11.533 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3632622050 0 0) 0x7fb420004bd0 con 0x7fb44008fa00 2021-02-06T22:52:11.533 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb440067960 con 0x7fb44008fa00 2021-02-06T22:52:11.533 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb4300019f0 con 0x7fb44008fa00 2021-02-06T22:52:11.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 543197720 0 0) 0x7fb440067960 con 0x7fb44008fa00 2021-02-06T22:52:11.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.51:6790/0 conn(0x7fb44008f550 legacy=0x7fb440091b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.51:6789/0 conn(0x7fb4400929c0 legacy=0x7fb4401423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440092290 con 0x7fb44008fa00 2021-02-06T22:52:11.534 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb440066810 con 0x7fb44008fa00 2021-02-06T22:52:11.535 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb44697f700 10 client.4114.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:11.535 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb440121290 con 0x7fb44008fa00 2021-02-06T22:52:11.535 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb44697f700 1 librados: init done 2021-02-06T22:52:11.535 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb4300015d0 con 0x7fb44008fa00 2021-02-06T22:52:11.535 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb430004f80 con 0x7fb44008fa00 2021-02-06T22:52:11.536 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.526+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7fb4300053b0 con 0x7fb44008fa00 2021-02-06T22:52:11.536 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (unknown 642963863 0 0) 0x7fb430005a80 con 0x7fb44008fa00 2021-02-06T22:52:11.536 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb427fff700 10 client.4114.objecter ms_dispatch 0x7fb440001510 osd_map(4..4 src has 1..4) v4 2021-02-06T22:52:11.536 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb427fff700 3 client.4114.objecter handle_osd_map got epochs [4,4] > 0 2021-02-06T22:52:11.536 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb427fff700 3 client.4114.objecter handle_osd_map decoding full epoch 4 2021-02-06T22:52:11.537 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb418004d60 con 0x7fb44008fa00 2021-02-06T22:52:11.537 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.527+0000 7fb427fff700 20 client.4114.objecter dump_active .. 0 homeless 2021-02-06T22:52:11.537 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.529+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7fb4300056f0 con 0x7fb44008fa00 2021-02-06T22:52:11.619 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.620+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "2c06d214-feb2-47bd-80ab-66827a74337f", "id": 2} v 0) v1 -- 0x7fb4180059b0 con 0x7fb44008fa00 2021-02-06T22:52:11.818 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.819+0000 7fb427fff700 1 -- 172.21.15.106:0/519663002 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c06d214-feb2-47bd-80ab-66827a74337f", "id": 2}]=0 v5) v1 ==== 112+0+2 (unknown 742247432 0 216599125) 0x7fb430006bb0 con 0x7fb44008fa00 2021-02-06T22:52:11.819 INFO:teuthology.orchestra.run.smithi106.stdout:2 2021-02-06T22:52:11.821 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 10 librados: watch_flush enter 2021-02-06T22:52:11.821 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 10 librados: watch_flush exit 2021-02-06T22:52:11.822 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 20 client.4114.objecter shutdown clearing up homeless session... 2021-02-06T22:52:11.822 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 10 client.4114.objecter successfully canceled tick 2021-02-06T22:52:11.822 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 >> v1:172.21.15.106:6789/0 conn(0x7fb44008fa00 legacy=0x7fb44013ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.822 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 shutdown_connections 2021-02-06T22:52:11.823 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 >> 172.21.15.106:0/519663002 conn(0x7fb440095fb0 msgr2=0x7fb4401281e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.823 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.822+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 shutdown_connections 2021-02-06T22:52:11.823 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.824+0000 7fb44697f700 1 -- 172.21.15.106:0/519663002 wait complete. 2021-02-06T22:52:11.824 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.824+0000 7fb44697f700 1 librados: shutdown 2021-02-06T22:52:11.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new cc2b0a47-2bc2-46d5-be82-d55c245ef76d 3 2021-02-06T22:52:11.962 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.963+0000 7f4bc3fff700 1 Processor -- start 2021-02-06T22:52:11.963 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.963+0000 7f4bc3fff700 1 -- start start 2021-02-06T22:52:11.963 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.963+0000 7f4bc3fff700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4092210 con 0x7f4bc4094750 2021-02-06T22:52:11.963 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.963+0000 7f4bc3fff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4091420 con 0x7f4bc40932d0 2021-02-06T22:52:11.963 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.963+0000 7f4bc3fff700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4092730 con 0x7f4bc4091c90 2021-02-06T22:52:11.964 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.964+0000 7f4bc27fc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4bc40932d0 0x7f4bc4090d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39032/0 (socket says 172.21.15.106:39032) 2021-02-06T22:52:11.964 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.964+0000 7f4bc27fc700 1 -- 172.21.15.106:0/1359009166 learned_addr learned my addr 172.21.15.106:0/1359009166 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.968 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc27fc700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.106:6789/0 conn(0x7f4bc40932d0 legacy=0x7f4bc4090d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.968 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389986665 0 0) 0x7f4bc4091420 con 0x7f4bc40932d0 2021-02-06T22:52:11.968 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb0003230 con 0x7f4bc40932d0 2021-02-06T22:52:11.969 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc37fe700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.51:6789/0 conn(0x7f4bc4094750 legacy=0x7f4bc412f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.969 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc2ffd700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.51:6790/0 conn(0x7f4bc4091c90 legacy=0x7f4bc4090600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.969 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 890059560 0 0) 0x7f4bb0003230 con 0x7f4bc40932d0 2021-02-06T22:52:11.969 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.51:6790/0 conn(0x7f4bc4091c90 legacy=0x7f4bc4090600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.969 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.51:6789/0 conn(0x7f4bc4094750 legacy=0x7f4bc412f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.970 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40929d0 con 0x7f4bc40932d0 2021-02-06T22:52:11.970 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bb8001930 con 0x7f4bc40932d0 2021-02-06T22:52:11.970 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4bb8001c40 con 0x7f4bc40932d0 2021-02-06T22:52:11.970 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.966+0000 7f4bc1ffb700 1 -- 172.21.15.106:0/1359009166 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bb8004750 con 0x7f4bc40932d0 2021-02-06T22:52:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.967+0000 7f4bc3fff700 1 -- 172.21.15.106:0/1359009166 >> v1:172.21.15.106:6789/0 conn(0x7f4bc40932d0 legacy=0x7f4bc4090d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.967+0000 7f4bc3fff700 1 -- 172.21.15.106:0/1359009166 shutdown_connections 2021-02-06T22:52:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.967+0000 7f4bc3fff700 1 -- 172.21.15.106:0/1359009166 >> 172.21.15.106:0/1359009166 conn(0x7f4bc4099280 msgr2=0x7f4bc4099690 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.967+0000 7f4bc3fff700 1 -- 172.21.15.106:0/1359009166 shutdown_connections 2021-02-06T22:52:11.971 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.967+0000 7f4bc3fff700 1 -- 172.21.15.106:0/1359009166 wait complete. 2021-02-06T22:52:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 librados: starting msgr at 2021-02-06T22:52:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 librados: starting objecter 2021-02-06T22:52:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 Processor -- start 2021-02-06T22:52:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 -- start start 2021-02-06T22:52:11.972 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 librados: setting wanted keys 2021-02-06T22:52:11.973 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 librados: calling monclient init 2021-02-06T22:52:11.973 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc411e620 con 0x7f4bc4094750 2021-02-06T22:52:11.973 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc41204d0 con 0x7f4bc4091c90 2021-02-06T22:52:11.973 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc3fff700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4120770 con 0x7f4bc40932d0 2021-02-06T22:52:11.973 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc2ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4bc4091c90 0x7f4bc412f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39036/0 (socket says 172.21.15.106:39036) 2021-02-06T22:52:11.974 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.968+0000 7f4bc2ffd700 1 -- 172.21.15.106:0/3022268772 learned_addr learned my addr 172.21.15.106:0/3022268772 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:11.977 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.970+0000 7f4bc2ffd700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.106:6789/0 conn(0x7f4bc4091c90 legacy=0x7f4bc412f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.977 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.970+0000 7f4baaffd700 10 client.?.objecter ms_handle_connect 0x7f4bc4091c90 2021-02-06T22:52:11.977 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.970+0000 7f4baaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.978 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 10 client.?.objecter ms_handle_connect 0x7f4bc4094750 2021-02-06T22:52:11.978 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.978 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 10 client.?.objecter ms_handle_connect 0x7f4bc40932d0 2021-02-06T22:52:11.978 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:11.978 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc37fe700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.51:6789/0 conn(0x7f4bc4094750 legacy=0x7f4bc413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.979 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc27fc700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.51:6790/0 conn(0x7f4bc40932d0 legacy=0x7f4bc412f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:11.979 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149854346 0 0) 0x7f4bc41204d0 con 0x7f4bc4091c90 2021-02-06T22:52:11.979 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ba4004bd0 con 0x7f4bc4091c90 2021-02-06T22:52:11.979 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004278035 0 0) 0x7f4bc411e620 con 0x7f4bc4094750 2021-02-06T22:52:11.979 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc41204d0 con 0x7f4bc4094750 2021-02-06T22:52:11.980 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462370583 0 0) 0x7f4bc4120770 con 0x7f4bc40932d0 2021-02-06T22:52:11.980 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc411e620 con 0x7f4bc40932d0 2021-02-06T22:52:11.980 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3271646203 0 0) 0x7f4ba4004bd0 con 0x7f4bc4091c90 2021-02-06T22:52:11.980 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4bc4120770 con 0x7f4bc4091c90 2021-02-06T22:52:11.981 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bb4001c20 con 0x7f4bc4091c90 2021-02-06T22:52:11.981 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3027297463 0 0) 0x7f4bc41204d0 con 0x7f4bc4094750 2021-02-06T22:52:11.981 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ba4004bd0 con 0x7f4bc4094750 2021-02-06T22:52:11.981 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bbc001f20 con 0x7f4bc4094750 2021-02-06T22:52:11.981 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 834985592 0 0) 0x7f4bc411e620 con 0x7f4bc40932d0 2021-02-06T22:52:11.982 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4bc41204d0 con 0x7f4bc40932d0 2021-02-06T22:52:11.982 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bb80018f0 con 0x7f4bc40932d0 2021-02-06T22:52:11.982 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 718402916 0 0) 0x7f4bc4120770 con 0x7f4bc4091c90 2021-02-06T22:52:11.982 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.51:6790/0 conn(0x7f4bc40932d0 legacy=0x7f4bc412f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.983 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.51:6789/0 conn(0x7f4bc4094750 legacy=0x7f4bc413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:11.983 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4067ca0 con 0x7f4bc4091c90 2021-02-06T22:52:11.983 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc411f3e0 con 0x7f4bc4091c90 2021-02-06T22:52:11.983 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc3fff700 10 client.4120.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc412a1d0 con 0x7f4bc4091c90 2021-02-06T22:52:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4bc3fff700 1 librados: init done 2021-02-06T22:52:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4bb40022e0 con 0x7f4bc4091c90 2021-02-06T22:52:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4bb40025f0 con 0x7f4bc4091c90 2021-02-06T22:52:11.984 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7f4bb4002a50 con 0x7f4bc4091c90 2021-02-06T22:52:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (unknown 116009688 0 0) 0x7f4bb4002ce0 con 0x7f4bc4091c90 2021-02-06T22:52:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 10 client.4120.objecter ms_dispatch 0x7f4bc4001510 osd_map(5..5 src has 1..5) v4 2021-02-06T22:52:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 3 client.4120.objecter handle_osd_map got epochs [5,5] > 0 2021-02-06T22:52:11.985 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 3 client.4120.objecter handle_osd_map decoding full epoch 5 2021-02-06T22:52:11.986 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.971+0000 7f4baaffd700 20 client.4120.objecter dump_active .. 0 homeless 2021-02-06T22:52:11.986 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.972+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c004d60 con 0x7f4bc4091c90 2021-02-06T22:52:11.986 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:11.974+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7f4bb40055d0 con 0x7f4bc4091c90 2021-02-06T22:52:12.064 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.065+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "cc2b0a47-2bc2-46d5-be82-d55c245ef76d", "id": 3} v 0) v1 -- 0x7f4b9c005430 con 0x7f4bc4091c90 2021-02-06T22:52:12.070 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.071+0000 7f4baaffd700 1 -- 172.21.15.106:0/3022268772 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc2b0a47-2bc2-46d5-be82-d55c245ef76d", "id": 3}]=0 v6) v1 ==== 112+0+2 (unknown 1546650184 0 525046306) 0x7f4bb4006020 con 0x7f4bc4091c90 2021-02-06T22:52:12.071 INFO:teuthology.orchestra.run.smithi106.stdout:3 2021-02-06T22:52:12.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 10 librados: watch_flush enter 2021-02-06T22:52:12.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 10 librados: watch_flush exit 2021-02-06T22:52:12.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 20 client.4120.objecter shutdown clearing up homeless session... 2021-02-06T22:52:12.072 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 10 client.4120.objecter successfully canceled tick 2021-02-06T22:52:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 >> v1:172.21.15.106:6789/0 conn(0x7f4bc4091c90 legacy=0x7f4bc412f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 shutdown_connections 2021-02-06T22:52:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 >> 172.21.15.106:0/3022268772 conn(0x7f4bc4099280 msgr2=0x7f4bc4066870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:12.073 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 shutdown_connections 2021-02-06T22:52:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 -- 172.21.15.106:0/3022268772 wait complete. 2021-02-06T22:52:12.074 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.072+0000 7f4bc3fff700 1 librados: shutdown 2021-02-06T22:52:12.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new a09f85c9-3129-42d5-9060-3d703102de17 4 2021-02-06T22:52:12.202 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.202+0000 7fd92e562700 1 Processor -- start 2021-02-06T22:52:12.203 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.202+0000 7fd92e562700 1 -- start start 2021-02-06T22:52:12.203 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.203+0000 7fd92e562700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928091c70 con 0x7fd928092500 2021-02-06T22:52:12.203 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.203+0000 7fd92e562700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92808fdf0 con 0x7fd928094da0 2021-02-06T22:52:12.204 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.203+0000 7fd92e562700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928091ea0 con 0x7fd928091430 2021-02-06T22:52:12.204 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.203+0000 7fd927fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 0x7fd92808efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39042/0 (socket says 172.21.15.106:39042) 2021-02-06T22:52:12.204 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.203+0000 7fd927fff700 1 -- 172.21.15.106:0/4127551590 learned_addr learned my addr 172.21.15.106:0/4127551590 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:12.206 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.205+0000 7fd927fff700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 legacy=0x7fd92808efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.206 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.205+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548464016 0 0) 0x7fd92808fdf0 con 0x7fd928094da0 2021-02-06T22:52:12.206 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.205+0000 7fd92caff700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.51:6789/0 conn(0x7fd928092500 legacy=0x7fd92812fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.207 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.205+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd914003230 con 0x7fd928094da0 2021-02-06T22:52:12.207 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.205+0000 7fd9277fe700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.51:6790/0 conn(0x7fd928091430 legacy=0x7fd92808f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.207 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1039586184 0 0) 0x7fd914003230 con 0x7fd928094da0 2021-02-06T22:52:12.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.51:6790/0 conn(0x7fd928091430 legacy=0x7fd92808f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.51:6789/0 conn(0x7fd928092500 legacy=0x7fd92812fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.208 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928092140 con 0x7fd928094da0 2021-02-06T22:52:12.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd91c0019f0 con 0x7fd928094da0 2021-02-06T22:52:12.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd91c001ce0 con 0x7fd928094da0 2021-02-06T22:52:12.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd926ffd700 1 -- 172.21.15.106:0/4127551590 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd91c004750 con 0x7fd928094da0 2021-02-06T22:52:12.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd92e562700 1 -- 172.21.15.106:0/4127551590 >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 legacy=0x7fd92808efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.209 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd92e562700 1 -- 172.21.15.106:0/4127551590 shutdown_connections 2021-02-06T22:52:12.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd92e562700 1 -- 172.21.15.106:0/4127551590 >> 172.21.15.106:0/4127551590 conn(0x7fd928095fb0 msgr2=0x7fd9280963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:12.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd92e562700 1 -- 172.21.15.106:0/4127551590 shutdown_connections 2021-02-06T22:52:12.210 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.206+0000 7fd92e562700 1 -- 172.21.15.106:0/4127551590 wait complete. 2021-02-06T22:52:12.213 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 librados: starting msgr at 2021-02-06T22:52:12.213 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 librados: starting objecter 2021-02-06T22:52:12.214 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 Processor -- start 2021-02-06T22:52:12.214 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 -- start start 2021-02-06T22:52:12.214 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 librados: setting wanted keys 2021-02-06T22:52:12.214 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.207+0000 7fd92e562700 1 librados: calling monclient init 2021-02-06T22:52:12.215 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.208+0000 7fd92e562700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928092ea0 con 0x7fd928091430 2021-02-06T22:52:12.215 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.208+0000 7fd92e562700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9281165d0 con 0x7fd928094da0 2021-02-06T22:52:12.215 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.208+0000 7fd92e562700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928097c70 con 0x7fd928092500 2021-02-06T22:52:12.215 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.208+0000 7fd92caff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 0x7fd92813dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39052/0 (socket says 172.21.15.106:39052) 2021-02-06T22:52:12.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.208+0000 7fd92caff700 1 -- 172.21.15.106:0/1609183452 learned_addr learned my addr 172.21.15.106:0/1609183452 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:12.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd92caff700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 legacy=0x7fd92813dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.216 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter ms_handle_connect 0x7fd928094da0 2021-02-06T22:52:12.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157005381 0 0) 0x7fd9281165d0 con 0x7fd928094da0 2021-02-06T22:52:12.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908004bd0 con 0x7fd928094da0 2021-02-06T22:52:12.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter ms_handle_connect 0x7fd928091430 2021-02-06T22:52:12.217 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd927fff700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.51:6789/0 conn(0x7fd928091430 legacy=0x7fd928135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd9277fe700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.51:6790/0 conn(0x7fd928092500 legacy=0x7fd92812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter ms_handle_connect 0x7fd928092500 2021-02-06T22:52:12.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.218 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3637891122 0 0) 0x7fd908004bd0 con 0x7fd928094da0 2021-02-06T22:52:12.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd9281165d0 con 0x7fd928094da0 2021-02-06T22:52:12.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd920001fc0 con 0x7fd928094da0 2021-02-06T22:52:12.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664888702 0 0) 0x7fd928092ea0 con 0x7fd928091430 2021-02-06T22:52:12.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.210+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908004bd0 con 0x7fd928091430 2021-02-06T22:52:12.219 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394479337 0 0) 0x7fd928097c70 con 0x7fd928092500 2021-02-06T22:52:12.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928092ea0 con 0x7fd928092500 2021-02-06T22:52:12.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3406381360 0 0) 0x7fd9281165d0 con 0x7fd928094da0 2021-02-06T22:52:12.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.51:6790/0 conn(0x7fd928092500 legacy=0x7fd92812f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.220 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.51:6789/0 conn(0x7fd928091430 legacy=0x7fd928135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92812fdd0 con 0x7fd928094da0 2021-02-06T22:52:12.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd928115bd0 con 0x7fd928094da0 2021-02-06T22:52:12.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd92e562700 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:12.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd928114590 con 0x7fd928094da0 2021-02-06T22:52:12.221 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd92e562700 1 librados: init done 2021-02-06T22:52:12.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd920002700 con 0x7fd928094da0 2021-02-06T22:52:12.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd920002a10 con 0x7fd928094da0 2021-02-06T22:52:12.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7fd920002eb0 con 0x7fd928094da0 2021-02-06T22:52:12.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (unknown 272796699 0 0) 0x7fd920006410 con 0x7fd928094da0 2021-02-06T22:52:12.222 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 10 client.4126.objecter ms_dispatch 0x7fd928001510 osd_map(6..6 src has 1..6) v4 2021-02-06T22:52:12.223 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 3 client.4126.objecter handle_osd_map got epochs [6,6] > 0 2021-02-06T22:52:12.223 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 3 client.4126.objecter handle_osd_map decoding full epoch 6 2021-02-06T22:52:12.223 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.211+0000 7fd90ffff700 20 client.4126.objecter dump_active .. 0 homeless 2021-02-06T22:52:12.224 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.212+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd900004d60 con 0x7fd928094da0 2021-02-06T22:52:12.224 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.214+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7fd920005950 con 0x7fd928094da0 2021-02-06T22:52:12.304 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.305+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a09f85c9-3129-42d5-9060-3d703102de17", "id": 4} v 0) v1 -- 0x7fd900005430 con 0x7fd928094da0 2021-02-06T22:52:12.310 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.310+0000 7fd90ffff700 1 -- 172.21.15.106:0/1609183452 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a09f85c9-3129-42d5-9060-3d703102de17", "id": 4}]=0 v7) v1 ==== 112+0+2 (unknown 1986480835 0 1697012583) 0x7fd920005ee0 con 0x7fd928094da0 2021-02-06T22:52:12.310 INFO:teuthology.orchestra.run.smithi106.stdout:4 2021-02-06T22:52:12.311 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 10 librados: watch_flush enter 2021-02-06T22:52:12.311 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 10 librados: watch_flush exit 2021-02-06T22:52:12.312 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 20 client.4126.objecter shutdown clearing up homeless session... 2021-02-06T22:52:12.312 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 10 client.4126.objecter successfully canceled tick 2021-02-06T22:52:12.312 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 >> v1:172.21.15.106:6789/0 conn(0x7fd928094da0 legacy=0x7fd92813dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.312 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 shutdown_connections 2021-02-06T22:52:12.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 >> 172.21.15.106:0/1609183452 conn(0x7fd928095fb0 msgr2=0x7fd928099200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:12.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 shutdown_connections 2021-02-06T22:52:12.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 -- 172.21.15.106:0/1609183452 wait complete. 2021-02-06T22:52:12.313 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.311+0000 7fd92e562700 1 librados: shutdown 2021-02-06T22:52:12.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 03ff8953-1929-4b0c-814c-bf7ce41c8729 5 2021-02-06T22:52:12.443 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.443+0000 7f66541a8700 1 Processor -- start 2021-02-06T22:52:12.443 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.443+0000 7f66541a8700 1 -- start start 2021-02-06T22:52:12.443 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.443+0000 7f66541a8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c094500 con 0x7f664c092cc0 2021-02-06T22:52:12.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.443+0000 7f66541a8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c091030 con 0x7f664c12ce50 2021-02-06T22:52:12.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.443+0000 7f66541a8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c0912d0 con 0x7f664c08f6d0 2021-02-06T22:52:12.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.444+0000 7f6652745700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f664c12ce50 0x7f664c12f240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39058/0 (socket says 172.21.15.106:39058) 2021-02-06T22:52:12.444 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.444+0000 7f6652745700 1 -- 172.21.15.106:0/1699982786 learned_addr learned my addr 172.21.15.106:0/1699982786 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:12.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6652745700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.106:6789/0 conn(0x7f664c12ce50 legacy=0x7f664c12f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257242803 0 0) 0x7f664c091030 con 0x7f664c12ce50 2021-02-06T22:52:12.448 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634003230 con 0x7f664c12ce50 2021-02-06T22:52:12.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6651743700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.51:6789/0 conn(0x7f664c092cc0 legacy=0x7f664c093170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6651f44700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.51:6790/0 conn(0x7f664c08f6d0 legacy=0x7f664c093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1817037299 0 0) 0x7f6634003230 con 0x7f664c12ce50 2021-02-06T22:52:12.449 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.51:6790/0 conn(0x7f664c08f6d0 legacy=0x7f664c093df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.51:6789/0 conn(0x7f664c092cc0 legacy=0x7f664c093170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c091570 con 0x7f664c12ce50 2021-02-06T22:52:12.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6644001cb0 con 0x7f664c12ce50 2021-02-06T22:52:12.450 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6644001fc0 con 0x7f664c12ce50 2021-02-06T22:52:12.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.446+0000 7f6650f42700 1 -- 172.21.15.106:0/1699982786 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6644004ad0 con 0x7f664c12ce50 2021-02-06T22:52:12.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.447+0000 7f66541a8700 1 -- 172.21.15.106:0/1699982786 >> v1:172.21.15.106:6789/0 conn(0x7f664c12ce50 legacy=0x7f664c12f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.447+0000 7f66541a8700 1 -- 172.21.15.106:0/1699982786 shutdown_connections 2021-02-06T22:52:12.451 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.447+0000 7f66541a8700 1 -- 172.21.15.106:0/1699982786 >> 172.21.15.106:0/1699982786 conn(0x7f664c095fb0 msgr2=0x7f664c0963c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:12.452 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.447+0000 7f66541a8700 1 -- 172.21.15.106:0/1699982786 shutdown_connections 2021-02-06T22:52:12.452 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.447+0000 7f66541a8700 1 -- 172.21.15.106:0/1699982786 wait complete. 2021-02-06T22:52:12.452 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 librados: starting msgr at 2021-02-06T22:52:12.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 librados: starting objecter 2021-02-06T22:52:12.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 Processor -- start 2021-02-06T22:52:12.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 -- start start 2021-02-06T22:52:12.453 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 librados: setting wanted keys 2021-02-06T22:52:12.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 librados: calling monclient init 2021-02-06T22:52:12.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c067e90 con 0x7f664c092cc0 2021-02-06T22:52:12.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c1255b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.454 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f66541a8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664c125850 con 0x7f664c12ce50 2021-02-06T22:52:12.455 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f6651f44700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f664c08f6d0 0x7f664c12bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39060/0 (socket says 172.21.15.106:39060) 2021-02-06T22:52:12.455 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.448+0000 7f6651f44700 1 -- 172.21.15.106:0/3178122025 learned_addr learned my addr 172.21.15.106:0/3178122025 (peer_addr_for_me v1:172.21.15.106:0/0) 2021-02-06T22:52:12.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.450+0000 7f6651f44700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.106:6789/0 conn(0x7f664c08f6d0 legacy=0x7f664c12bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.450+0000 7f6639ffb700 10 client.?.objecter ms_handle_connect 0x7f664c08f6d0 2021-02-06T22:52:12.458 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.450+0000 7f6639ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237685278 0 0) 0x7f664c1255b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f662c004bd0 con 0x7f664c08f6d0 2021-02-06T22:52:12.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 10 client.?.objecter ms_handle_connect 0x7f664c092cc0 2021-02-06T22:52:12.459 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6651743700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.51:6789/0 conn(0x7f664c092cc0 legacy=0x7f664c13cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 10 client.?.objecter ms_handle_connect 0x7f664c12ce50 2021-02-06T22:52:12.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:12.460 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6652745700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.51:6790/0 conn(0x7f664c12ce50 legacy=0x7f664c1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:12.461 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 762392056 0 0) 0x7f662c004bd0 con 0x7f664c08f6d0 2021-02-06T22:52:12.461 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f664c1255b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.461 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6648001c40 con 0x7f664c08f6d0 2021-02-06T22:52:12.461 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100573196 0 0) 0x7f664c067e90 con 0x7f664c092cc0 2021-02-06T22:52:12.462 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f662c004bd0 con 0x7f664c092cc0 2021-02-06T22:52:12.462 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863102457 0 0) 0x7f664c125850 con 0x7f664c12ce50 2021-02-06T22:52:12.462 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f664c067e90 con 0x7f664c12ce50 2021-02-06T22:52:12.462 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2902885762 0 0) 0x7f664c1255b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.463 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.51:6790/0 conn(0x7f664c12ce50 legacy=0x7f664c1403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.463 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.51:6789/0 conn(0x7f664c092cc0 legacy=0x7f664c13cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.463 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c097d50 con 0x7f664c08f6d0 2021-02-06T22:52:12.463 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664c1387a0 con 0x7f664c08f6d0 2021-02-06T22:52:12.463 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f66480023b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.464 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f66480026c0 con 0x7f664c08f6d0 2021-02-06T22:52:12.464 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7f6648002b70 con 0x7f664c08f6d0 2021-02-06T22:52:12.464 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f66541a8700 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:12.464 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f664c133f20 con 0x7f664c08f6d0 2021-02-06T22:52:12.464 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.451+0000 7f66541a8700 1 librados: init done 2021-02-06T22:52:12.465 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (unknown 2514275885 0 0) 0x7f6648005610 con 0x7f664c08f6d0 2021-02-06T22:52:12.465 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f6639ffb700 10 client.4132.objecter ms_dispatch 0x7f664c001510 osd_map(7..7 src has 1..7) v4 2021-02-06T22:52:12.465 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f6639ffb700 3 client.4132.objecter handle_osd_map got epochs [7,7] > 0 2021-02-06T22:52:12.465 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f6639ffb700 3 client.4132.objecter handle_osd_map decoding full epoch 7 2021-02-06T22:52:12.466 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f664c0581b0 con 0x7f664c08f6d0 2021-02-06T22:52:12.466 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.452+0000 7f6639ffb700 20 client.4132.objecter dump_active .. 0 homeless 2021-02-06T22:52:12.466 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.454+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7f66480178e0 con 0x7f664c08f6d0 2021-02-06T22:52:12.544 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.544+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd new", "uuid": "03ff8953-1929-4b0c-814c-bf7ce41c8729", "id": 5} v 0) v1 -- 0x7f664c05db20 con 0x7f664c08f6d0 2021-02-06T22:52:12.552 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.552+0000 7f6639ffb700 1 -- 172.21.15.106:0/3178122025 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "03ff8953-1929-4b0c-814c-bf7ce41c8729", "id": 5}]=0 v8) v1 ==== 112+0+2 (unknown 1973578759 0 1988412176) 0x7f66480060e0 con 0x7f664c08f6d0 2021-02-06T22:52:12.552 INFO:teuthology.orchestra.run.smithi106.stdout:5 2021-02-06T22:52:12.553 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.553+0000 7f66541a8700 10 librados: watch_flush enter 2021-02-06T22:52:12.554 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 10 librados: watch_flush exit 2021-02-06T22:52:12.554 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 20 client.4132.objecter shutdown clearing up homeless session... 2021-02-06T22:52:12.554 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 10 client.4132.objecter successfully canceled tick 2021-02-06T22:52:12.555 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 >> v1:172.21.15.106:6789/0 conn(0x7f664c08f6d0 legacy=0x7f664c12bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:12.555 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 shutdown_connections 2021-02-06T22:52:12.555 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 >> 172.21.15.106:0/3178122025 conn(0x7f664c095fb0 msgr2=0x7f664c099270 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:12.555 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 shutdown_connections 2021-02-06T22:52:12.555 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 -- 172.21.15.106:0/3178122025 wait complete. 2021-02-06T22:52:12.556 INFO:teuthology.orchestra.run.smithi106.stderr:2021-02-06T22:52:12.554+0000 7f66541a8700 1 librados: shutdown 2021-02-06T22:52:12.564 INFO:tasks.ceph.osd.0:Restarting daemon 2021-02-06T22:52:12.565 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2021-02-06T22:52:12.567 INFO:tasks.ceph.osd.0:Started 2021-02-06T22:52:12.568 INFO:tasks.ceph.osd.1:Restarting daemon 2021-02-06T22:52:12.568 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2021-02-06T22:52:12.570 INFO:tasks.ceph.osd.1:Started 2021-02-06T22:52:12.571 INFO:tasks.ceph.osd.2:Restarting daemon 2021-02-06T22:52:12.571 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2021-02-06T22:52:12.574 INFO:tasks.ceph.osd.2:Started 2021-02-06T22:52:12.574 INFO:tasks.ceph.osd.3:Restarting daemon 2021-02-06T22:52:12.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2021-02-06T22:52:12.577 INFO:tasks.ceph.osd.3:Started 2021-02-06T22:52:12.578 INFO:tasks.ceph.osd.4:Restarting daemon 2021-02-06T22:52:12.578 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2021-02-06T22:52:12.580 INFO:tasks.ceph.osd.4:Started 2021-02-06T22:52:12.581 INFO:tasks.ceph.osd.5:Restarting daemon 2021-02-06T22:52:12.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2021-02-06T22:52:12.583 INFO:tasks.ceph.osd.5:Started 2021-02-06T22:52:12.584 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-06T22:52:13.174 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-02-06T22:52:13.174+0000 7f373a0c9200 -1 Falling back to public interface 2021-02-06T22:52:13.178 INFO:tasks.ceph.osd.1.smithi051.stderr:2021-02-06T22:52:13.179+0000 7f580da8a200 -1 Falling back to public interface 2021-02-06T22:52:13.178 INFO:tasks.ceph.osd.0.smithi051.stderr:2021-02-06T22:52:13.179+0000 7f1c91e4f200 -1 Falling back to public interface 2021-02-06T22:52:13.181 INFO:tasks.ceph.osd.2.smithi051.stderr:2021-02-06T22:52:13.182+0000 7f7f89608200 -1 Falling back to public interface 2021-02-06T22:52:13.183 INFO:tasks.ceph.osd.3.smithi106.stderr:2021-02-06T22:52:13.184+0000 7f7b82a58200 -1 Falling back to public interface 2021-02-06T22:52:13.183 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-02-06T22:52:13.184+0000 7f50a1762200 -1 Falling back to public interface 2021-02-06T22:52:13.184 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-02-06T22:52:13.184+0000 7f509b6fb700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2021-02-06T22:52:13.189 DEBUG:teuthology.orchestra.run.smithi051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-06T22:52:13.312 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.312+0000 7f5f2cc64700 1 Processor -- start 2021-02-06T22:52:13.312 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.312+0000 7f5f2cc64700 1 -- start start 2021-02-06T22:52:13.312 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f2cc64700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f28094e00 con 0x7f5f280670e0 2021-02-06T22:52:13.313 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f2cc64700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f280639b0 con 0x7f5f28067540 2021-02-06T22:52:13.313 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f2cc64700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2812aba0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.313 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f2659c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5f2805c0d0 0x7f5f2812a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59448/0 (socket says 172.21.15.51:59448) 2021-02-06T22:52:13.313 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f25d9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f5f280670e0 0x7f5f2812f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59106/0 (socket says 172.21.15.51:59106) 2021-02-06T22:52:13.314 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.313+0000 7f5f2659c700 1 -- 172.21.15.51:0/2604490489 learned_addr learned my addr 172.21.15.51:0/2604490489 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:13.315 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f25d9b700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.51:6789/0 conn(0x7f5f280670e0 legacy=0x7f5f2812f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.316 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2659c700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.51:6790/0 conn(0x7f5f2805c0d0 legacy=0x7f5f2812a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.316 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f26d9d700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.106:6789/0 conn(0x7f5f28067540 legacy=0x7f5f28132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.316 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351745287 0 0) 0x7f5f2812aba0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.316 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c003230 con 0x7f5f2805c0d0 2021-02-06T22:52:13.317 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89814237 0 0) 0x7f5f28094e00 con 0x7f5f280670e0 2021-02-06T22:52:13.317 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f2812aba0 con 0x7f5f280670e0 2021-02-06T22:52:13.317 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851859781 0 0) 0x7f5f280639b0 con 0x7f5f28067540 2021-02-06T22:52:13.317 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f28094e00 con 0x7f5f28067540 2021-02-06T22:52:13.317 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3447652764 0 0) 0x7f5f0c003230 con 0x7f5f2805c0d0 2021-02-06T22:52:13.318 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.106:6789/0 conn(0x7f5f28067540 legacy=0x7f5f28132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.318 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.51:6789/0 conn(0x7f5f280670e0 legacy=0x7f5f2812f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.318 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28095e20 con 0x7f5f2805c0d0 2021-02-06T22:52:13.318 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.315+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5f180018a0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.318 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f18001bb0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.319 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2559a700 1 -- 172.21.15.51:0/2604490489 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5f180045b0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.319 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2cc64700 1 -- 172.21.15.51:0/2604490489 >> v1:172.21.15.51:6790/0 conn(0x7f5f2805c0d0 legacy=0x7f5f2812a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.319 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2cc64700 1 -- 172.21.15.51:0/2604490489 shutdown_connections 2021-02-06T22:52:13.319 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2cc64700 1 -- 172.21.15.51:0/2604490489 >> 172.21.15.51:0/2604490489 conn(0x7f5f28099a10 msgr2=0x7f5f28099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:13.319 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2cc64700 1 -- 172.21.15.51:0/2604490489 shutdown_connections 2021-02-06T22:52:13.320 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.316+0000 7f5f2cc64700 1 -- 172.21.15.51:0/2604490489 wait complete. 2021-02-06T22:52:13.323 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 librados: starting msgr at 2021-02-06T22:52:13.323 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 librados: starting objecter 2021-02-06T22:52:13.323 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 Processor -- start 2021-02-06T22:52:13.324 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 -- start start 2021-02-06T22:52:13.324 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 librados: setting wanted keys 2021-02-06T22:52:13.324 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.317+0000 7f5f2cc64700 1 librados: calling monclient init 2021-02-06T22:52:13.324 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.318+0000 7f5f2cc64700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f281132a0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.324 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.318+0000 7f5f2cc64700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f281134d0 con 0x7f5f28067540 2021-02-06T22:52:13.325 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.318+0000 7f5f2cc64700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f28113770 con 0x7f5f280670e0 2021-02-06T22:52:13.325 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.318+0000 7f5f25d9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5f280670e0 0x7f5f2813ed90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59454/0 (socket says 172.21.15.51:59454) 2021-02-06T22:52:13.325 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.318+0000 7f5f25d9b700 1 -- 172.21.15.51:0/3877297606 learned_addr learned my addr 172.21.15.51:0/3877297606 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:13.325 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f2659c700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.51:6789/0 conn(0x7f5f2805c0d0 legacy=0x7f5f2813a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.325 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter ms_handle_connect 0x7f5f2805c0d0 2021-02-06T22:52:13.326 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:13.326 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f25d9b700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.51:6790/0 conn(0x7f5f280670e0 legacy=0x7f5f2813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.326 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter ms_handle_connect 0x7f5f280670e0 2021-02-06T22:52:13.326 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:13.327 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f26d9d700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.106:6789/0 conn(0x7f5f28067540 legacy=0x7f5f281424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:13.327 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter ms_handle_connect 0x7f5f28067540 2021-02-06T22:52:13.327 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:13.327 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535891273 0 0) 0x7f5f281132a0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.327 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f04004bd0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.328 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932150370 0 0) 0x7f5f28113770 con 0x7f5f280670e0 2021-02-06T22:52:13.328 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f281132a0 con 0x7f5f280670e0 2021-02-06T22:52:13.328 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3627273201 0 0) 0x7f5f04004bd0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.328 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5f28113770 con 0x7f5f2805c0d0 2021-02-06T22:52:13.328 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5f18001250 con 0x7f5f2805c0d0 2021-02-06T22:52:13.329 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 681864103 0 0) 0x7f5f281132a0 con 0x7f5f280670e0 2021-02-06T22:52:13.329 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5f04004bd0 con 0x7f5f280670e0 2021-02-06T22:52:13.329 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5f1c001990 con 0x7f5f280670e0 2021-02-06T22:52:13.329 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 493426934 0 0) 0x7f5f28113770 con 0x7f5f2805c0d0 2021-02-06T22:52:13.329 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.51:6790/0 conn(0x7f5f280670e0 legacy=0x7f5f2813ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.330 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.106:6789/0 conn(0x7f5f28067540 legacy=0x7f5f281424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.330 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.320+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28113a10 con 0x7f5f2805c0d0 2021-02-06T22:52:13.330 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f281118a0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.330 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f2cc64700 10 client.4149.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:13.330 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2813a840 con 0x7f5f2805c0d0 2021-02-06T22:52:13.331 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f2cc64700 1 librados: init done 2021-02-06T22:52:13.331 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5f18004c80 con 0x7f5f2805c0d0 2021-02-06T22:52:13.331 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5f18004df0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.331 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 1) v1 ==== 484+0+0 (unknown 963703864 0 0) 0x7f5f180051a0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.331 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (unknown 3944954153 0 0) 0x7f5f180061f0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.332 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 10 client.4149.objecter ms_dispatch 0x7f5f28001510 osd_map(8..8 src has 1..8) v4 2021-02-06T22:52:13.332 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 3 client.4149.objecter handle_osd_map got epochs [8,8] > 0 2021-02-06T22:52:13.332 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 3 client.4149.objecter handle_osd_map decoding full epoch 8 2021-02-06T22:52:13.332 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f167fc700 20 client.4149.objecter dump_active .. 0 homeless 2021-02-06T22:52:13.332 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.321+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f08004d60 con 0x7f5f2805c0d0 2021-02-06T22:52:13.333 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.324+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71894 (unknown 1092875540 0 907224215) 0x7f5f180055e0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.399 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.400+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f08005430 con 0x7f5f2805c0d0 2021-02-06T22:52:13.401 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.401+0000 7f5f167fc700 1 -- 172.21.15.51:0/3877297606 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+5548 (unknown 150273500 0 1020960220) 0x7f5f18005be0 con 0x7f5f2805c0d0 2021-02-06T22:52:13.401 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.401+0000 7f5f2cc64700 10 librados: watch_flush enter 2021-02-06T22:52:13.402 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.401+0000 7f5f2cc64700 10 librados: watch_flush exit 2021-02-06T22:52:13.402 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.401+0000 7f5f2cc64700 20 client.4149.objecter shutdown clearing up homeless session... 2021-02-06T22:52:13.402 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 10 client.4149.objecter successfully canceled tick 2021-02-06T22:52:13.402 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 >> v1:172.21.15.51:6789/0 conn(0x7f5f2805c0d0 legacy=0x7f5f2813a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:13.403 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 shutdown_connections 2021-02-06T22:52:13.403 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 >> 172.21.15.51:0/3877297606 conn(0x7f5f28099a10 msgr2=0x7f5f2812d790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:13.403 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 shutdown_connections 2021-02-06T22:52:13.403 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 -- 172.21.15.51:0/3877297606 wait complete. 2021-02-06T22:52:13.403 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:13.402+0000 7f5f2cc64700 1 librados: shutdown 2021-02-06T22:52:13.404 INFO:teuthology.misc.health.smithi051.stdout: 2021-02-06T22:52:13.404 INFO:teuthology.misc.health.smithi051.stdout:{"epoch":8,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:12.546685+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:52:13.411 DEBUG:teuthology.misc:0 of 6 OSDs are up 2021-02-06T22:52:14.643 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:14.644+0000 7f330aba9700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'devicehealth' while running on mgr.x: name 'cast' is not defined 2021-02-06T22:52:14.644 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:14.644+0000 7f330aba9700 -1 devicehealth.serve: 2021-02-06T22:52:14.645 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:14.644+0000 7f330aba9700 -1 Traceback (most recent call last): 2021-02-06T22:52:14.645 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 298, in serve 2021-02-06T22:52:14.645 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.scrape_all() 2021-02-06T22:52:14.646 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 337, in scrape_all 2021-02-06T22:52:14.646 INFO:tasks.ceph.mgr.x.smithi106.stderr: ioctx = self.open_connection() 2021-02-06T22:52:14.646 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 316, in open_connection 2021-02-06T22:52:14.646 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.maybe_create_device_pool(): 2021-02-06T22:52:14.647 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:14.647 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:14.647 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:14.647 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:14.648 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:14.648 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:16.624 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-02-06T22:52:16.624+0000 7f373a0c9200 -1 osd.4 0 log_to_monitors {default=true} 2021-02-06T22:52:16.630 INFO:tasks.ceph.osd.1.smithi051.stderr:2021-02-06T22:52:16.631+0000 7f580da8a200 -1 osd.1 0 log_to_monitors {default=true} 2021-02-06T22:52:16.650 INFO:tasks.ceph.osd.3.smithi106.stderr:2021-02-06T22:52:16.650+0000 7f7b82a58200 -1 osd.3 0 log_to_monitors {default=true} 2021-02-06T22:52:16.650 INFO:tasks.ceph.osd.0.smithi051.stderr:2021-02-06T22:52:16.651+0000 7f1c91e4f200 -1 osd.0 0 log_to_monitors {default=true} 2021-02-06T22:52:16.666 INFO:tasks.ceph.osd.2.smithi051.stderr:2021-02-06T22:52:16.667+0000 7f7f89608200 -1 osd.2 0 log_to_monitors {default=true} 2021-02-06T22:52:16.676 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-02-06T22:52:16.677+0000 7f50a1762200 -1 osd.5 0 log_to_monitors {default=true} 2021-02-06T22:52:17.192 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:17.192+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:17.192 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:17.192+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:17.192 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:17.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:17.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:17.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:17.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:17.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:17.194 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:17.194 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:18.186 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:18.187+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:18.187 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:18.187+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:18.187 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:18.187 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:18.187 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:18.187 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:18.188 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:18.188 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:18.188 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:18.188 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:18.192 INFO:tasks.ceph.osd.4.smithi106.stderr:2021-02-06T22:52:18.193+0000 7f373085b700 -1 osd.4 0 waiting for initial osdmap 2021-02-06T22:52:18.193 INFO:tasks.ceph.osd.5.smithi106.stderr:2021-02-06T22:52:18.193+0000 7f5097ef4700 -1 osd.5 0 waiting for initial osdmap 2021-02-06T22:52:18.193 INFO:tasks.ceph.osd.0.smithi051.stderr:2021-02-06T22:52:18.193+0000 7f1c885e1700 -1 osd.0 0 waiting for initial osdmap 2021-02-06T22:52:18.194 INFO:tasks.ceph.osd.1.smithi051.stderr:2021-02-06T22:52:18.194+0000 7f580421c700 -1 osd.1 0 waiting for initial osdmap 2021-02-06T22:52:18.194 INFO:tasks.ceph.osd.2.smithi051.stderr:2021-02-06T22:52:18.194+0000 7f7f7fd9a700 -1 osd.2 0 waiting for initial osdmap 2021-02-06T22:52:18.194 INFO:tasks.ceph.osd.3.smithi106.stderr:2021-02-06T22:52:18.193+0000 7f7b791ea700 -1 osd.3 0 waiting for initial osdmap 2021-02-06T22:52:19.192 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:19.192+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:19.192 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:19.192+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:19.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:19.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:19.193 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:19.194 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:19.194 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:19.194 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:19.194 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:19.194 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:20.019 DEBUG:teuthology.orchestra.run.smithi051:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-06T22:52:20.143 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.144+0000 7f113eb93700 1 Processor -- start 2021-02-06T22:52:20.144 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.144+0000 7f113eb93700 1 -- start start 2021-02-06T22:52:20.145 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113eb93700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380639f0 con 0x7f1138091e60 2021-02-06T22:52:20.145 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113eb93700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1138063c90 con 0x7f1138095480 2021-02-06T22:52:20.145 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113eb93700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380631b0 con 0x7f11381306b0 2021-02-06T22:52:20.145 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113d130700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f11381306b0 0x7f1138132aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59560/0 (socket says 172.21.15.51:59560) 2021-02-06T22:52:20.145 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113c92f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f1138091e60 0x7f1138094b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59216/0 (socket says 172.21.15.51:59216) 2021-02-06T22:52:20.146 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.145+0000 7f113d130700 1 -- 172.21.15.51:0/3162410898 learned_addr learned my addr 172.21.15.51:0/3162410898 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:20.148 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f113c92f700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.51:6789/0 conn(0x7f1138091e60 legacy=0x7f1138094b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.148 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f113d130700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.51:6790/0 conn(0x7f11381306b0 legacy=0x7f1138132aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.148 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f1137fff700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.106:6789/0 conn(0x7f1138095480 legacy=0x7f113812ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.148 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005290747 0 0) 0x7f11380639f0 con 0x7f1138091e60 2021-02-06T22:52:20.149 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f111c003230 con 0x7f1138091e60 2021-02-06T22:52:20.149 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178366137 0 0) 0x7f11380631b0 con 0x7f11381306b0 2021-02-06T22:52:20.149 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.147+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11380639f0 con 0x7f11381306b0 2021-02-06T22:52:20.149 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 331964840 0 0) 0x7f1138063c90 con 0x7f1138095480 2021-02-06T22:52:20.149 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11380631b0 con 0x7f1138095480 2021-02-06T22:52:20.150 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2099323138 0 0) 0x7f111c003230 con 0x7f1138091e60 2021-02-06T22:52:20.150 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.51:6790/0 conn(0x7f11381306b0 legacy=0x7f1138132aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.150 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.106:6789/0 conn(0x7f1138095480 legacy=0x7f113812ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.150 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138092240 con 0x7f1138091e60 2021-02-06T22:52:20.151 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f112c001930 con 0x7f1138091e60 2021-02-06T22:52:20.151 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f112c001c40 con 0x7f1138091e60 2021-02-06T22:52:20.151 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f11377fe700 1 -- 172.21.15.51:0/3162410898 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f112c004690 con 0x7f1138091e60 2021-02-06T22:52:20.151 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f113eb93700 1 -- 172.21.15.51:0/3162410898 >> v1:172.21.15.51:6789/0 conn(0x7f1138091e60 legacy=0x7f1138094b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.151 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f113eb93700 1 -- 172.21.15.51:0/3162410898 shutdown_connections 2021-02-06T22:52:20.152 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f113eb93700 1 -- 172.21.15.51:0/3162410898 >> 172.21.15.51:0/3162410898 conn(0x7f113809b510 msgr2=0x7f113809b920 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:20.152 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f113eb93700 1 -- 172.21.15.51:0/3162410898 shutdown_connections 2021-02-06T22:52:20.152 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.148+0000 7f113eb93700 1 -- 172.21.15.51:0/3162410898 wait complete. 2021-02-06T22:52:20.155 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 librados: starting msgr at 2021-02-06T22:52:20.156 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 librados: starting objecter 2021-02-06T22:52:20.156 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 Processor -- start 2021-02-06T22:52:20.156 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 -- start start 2021-02-06T22:52:20.156 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 librados: setting wanted keys 2021-02-06T22:52:20.157 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.149+0000 7f113eb93700 1 librados: calling monclient init 2021-02-06T22:52:20.157 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.150+0000 7f113eb93700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113812fe00 con 0x7f11381306b0 2021-02-06T22:52:20.157 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.150+0000 7f113eb93700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1138116e30 con 0x7f1138095480 2021-02-06T22:52:20.157 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.150+0000 7f113eb93700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11381170d0 con 0x7f1138091e60 2021-02-06T22:52:20.157 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.150+0000 7f113c92f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f1138091e60 0x7f113812f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59564/0 (socket says 172.21.15.51:59564) 2021-02-06T22:52:20.158 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.150+0000 7f113c92f700 1 -- 172.21.15.51:0/1017806470 learned_addr learned my addr 172.21.15.51:0/1017806470 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:20.158 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f113c92f700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.51:6790/0 conn(0x7f1138091e60 legacy=0x7f113812f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.158 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f113d130700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.51:6789/0 conn(0x7f11381306b0 legacy=0x7f1138142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.158 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter ms_handle_connect 0x7f1138091e60 2021-02-06T22:52:20.158 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.159 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter ms_handle_connect 0x7f11381306b0 2021-02-06T22:52:20.159 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.159 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter ms_handle_connect 0x7f1138095480 2021-02-06T22:52:20.159 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.159 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1137fff700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.106:6789/0 conn(0x7f1138095480 legacy=0x7f113813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.160 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481341129 0 0) 0x7f11381170d0 con 0x7f1138091e60 2021-02-06T22:52:20.160 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1118004bd0 con 0x7f1138091e60 2021-02-06T22:52:20.160 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099086527 0 0) 0x7f113812fe00 con 0x7f11381306b0 2021-02-06T22:52:20.160 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11381170d0 con 0x7f11381306b0 2021-02-06T22:52:20.161 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069727185 0 0) 0x7f1138116e30 con 0x7f1138095480 2021-02-06T22:52:20.161 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.152+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f113812fe00 con 0x7f1138095480 2021-02-06T22:52:20.161 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 102535281 0 0) 0x7f11381170d0 con 0x7f11381306b0 2021-02-06T22:52:20.161 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1138116e30 con 0x7f11381306b0 2021-02-06T22:52:20.161 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 773969161 0 0) 0x7f1118004bd0 con 0x7f1138091e60 2021-02-06T22:52:20.162 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f11381170d0 con 0x7f1138091e60 2021-02-06T22:52:20.162 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1130001d10 con 0x7f11381306b0 2021-02-06T22:52:20.162 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f112c0018f0 con 0x7f1138091e60 2021-02-06T22:52:20.162 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1377049871 0 0) 0x7f113812fe00 con 0x7f1138095480 2021-02-06T22:52:20.162 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1118004bd0 con 0x7f1138095480 2021-02-06T22:52:20.163 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1124001b60 con 0x7f1138095480 2021-02-06T22:52:20.163 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3842652801 0 0) 0x7f1138116e30 con 0x7f11381306b0 2021-02-06T22:52:20.163 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.51:6790/0 conn(0x7f1138091e60 legacy=0x7f113812f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.163 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.106:6789/0 conn(0x7f1138095480 legacy=0x7f113813e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.163 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138068240 con 0x7f11381306b0 2021-02-06T22:52:20.164 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138115e20 con 0x7f11381306b0 2021-02-06T22:52:20.164 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f113eb93700 10 client.4182.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:20.164 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f113813a280 con 0x7f11381306b0 2021-02-06T22:52:20.164 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f113eb93700 1 librados: init done 2021-02-06T22:52:20.164 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1130004b60 con 0x7f11381306b0 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.153+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1130004e70 con 0x7f11381306b0 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f1130005050 con 0x7f11381306b0 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 2796+0+0 (unknown 3759420980 0 0) 0x7f1130039620 con 0x7f11381306b0 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 10 client.4182.objecter ms_dispatch 0x7f1138001510 osd_map(11..11 src has 1..11) v4 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 3 client.4182.objecter handle_osd_map got epochs [11,11] > 0 2021-02-06T22:52:20.165 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 3 client.4182.objecter handle_osd_map decoding full epoch 11 2021-02-06T22:52:20.166 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f1134ff9700 20 client.4182.objecter dump_active .. 0 homeless 2021-02-06T22:52:20.166 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.154+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110004d60 con 0x7f11381306b0 2021-02-06T22:52:20.166 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.156+0000 7f1134ff9700 10 client.4182.objecter ms_handle_connect 0x7f1118030780 2021-02-06T22:52:20.167 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.158+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f1130012610 con 0x7f11381306b0 2021-02-06T22:52:20.194 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:52:20.195+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'devicehealth' has failed: name 'cast' is not defined (MGR_MODULE_ERROR) 2021-02-06T22:52:20.203 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:20.202+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:20.203 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:20.202+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:20.204 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:20.204 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:20.204 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:20.204 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:20.204 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:20.205 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:20.205 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:20.205 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:20.342 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.343+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1110005430 con 0x7f11381306b0 2021-02-06T22:52:20.343 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.344+0000 7f1134ff9700 1 -- 172.21.15.51:0/1017806470 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6921 (unknown 4250787923 0 3931180895) 0x7f1130012200 con 0x7f11381306b0 2021-02-06T22:52:20.343 INFO:teuthology.misc.health.smithi051.stdout: 2021-02-06T22:52:20.344 INFO:teuthology.misc.health.smithi051.stdout:{"epoch":12,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:20.198190+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:52:20.345 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.345+0000 7f113eb93700 10 librados: watch_flush enter 2021-02-06T22:52:20.345 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.345+0000 7f113eb93700 10 librados: watch_flush exit 2021-02-06T22:52:20.346 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.345+0000 7f113eb93700 20 client.4182.objecter shutdown clearing up homeless session... 2021-02-06T22:52:20.346 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.345+0000 7f113eb93700 10 client.4182.objecter successfully canceled tick 2021-02-06T22:52:20.346 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.106:6812/33219 conn(0x7f1118030780 legacy=0x7f1118032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.346 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 >> v1:172.21.15.51:6789/0 conn(0x7f11381306b0 legacy=0x7f1138142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.346 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 shutdown_connections 2021-02-06T22:52:20.347 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 >> 172.21.15.51:0/1017806470 conn(0x7f113809b510 msgr2=0x7f11380947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:20.347 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 shutdown_connections 2021-02-06T22:52:20.347 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 -- 172.21.15.51:0/1017806470 wait complete. 2021-02-06T22:52:20.347 INFO:teuthology.misc.health.smithi051.stderr:2021-02-06T22:52:20.346+0000 7f113eb93700 1 librados: shutdown 2021-02-06T22:52:20.355 DEBUG:teuthology.misc:6 of 6 OSDs are up 2021-02-06T22:52:20.356 INFO:tasks.ceph:Creating RBD pool 2021-02-06T22:52:20.356 DEBUG:teuthology.orchestra.run.smithi051:> sudo ceph --cluster ceph osd pool create rbd 8 2021-02-06T22:52:20.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.478+0000 7fbef80c7700 1 Processor -- start 2021-02-06T22:52:20.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.478+0000 7fbef80c7700 1 -- start start 2021-02-06T22:52:20.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef80c7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef00944b0 con 0x7fbef012cef0 2021-02-06T22:52:20.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef80c7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef0090fc0 con 0x7fbef008f600 2021-02-06T22:52:20.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef80c7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef0091260 con 0x7fbef0092c50 2021-02-06T22:52:20.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef5662700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fbef0092c50 0x7fbef00930e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59572/0 (socket says 172.21.15.51:59572) 2021-02-06T22:52:20.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef6664700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fbef012cef0 0x7fbef012f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59234/0 (socket says 172.21.15.51:59234) 2021-02-06T22:52:20.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.479+0000 7fbef5662700 1 -- 172.21.15.51:0/2229286134 learned_addr learned my addr 172.21.15.51:0/2229286134 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:20.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef6664700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.51:6789/0 conn(0x7fbef012cef0 legacy=0x7fbef012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef5662700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.51:6790/0 conn(0x7fbef0092c50 legacy=0x7fbef00930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521060461 0 0) 0x7fbef00944b0 con 0x7fbef012cef0 2021-02-06T22:52:20.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed8003230 con 0x7fbef012cef0 2021-02-06T22:52:20.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541174045 0 0) 0x7fbef0091260 con 0x7fbef0092c50 2021-02-06T22:52:20.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef00944b0 con 0x7fbef0092c50 2021-02-06T22:52:20.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef5e63700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.106:6789/0 conn(0x7fbef008f600 legacy=0x7fbef0093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4147468198 0 0) 0x7fbed8003230 con 0x7fbef012cef0 2021-02-06T22:52:20.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.51:6790/0 conn(0x7fbef0092c50 legacy=0x7fbef00930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.106:6789/0 conn(0x7fbef008f600 legacy=0x7fbef0093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0091500 con 0x7fbef012cef0 2021-02-06T22:52:20.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbee8001cb0 con 0x7fbef012cef0 2021-02-06T22:52:20.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.481+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbee8001fd0 con 0x7fbef012cef0 2021-02-06T22:52:20.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef4e61700 1 -- 172.21.15.51:0/2229286134 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbee8004a10 con 0x7fbef012cef0 2021-02-06T22:52:20.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef80c7700 1 -- 172.21.15.51:0/2229286134 >> v1:172.21.15.51:6789/0 conn(0x7fbef012cef0 legacy=0x7fbef012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef80c7700 1 -- 172.21.15.51:0/2229286134 shutdown_connections 2021-02-06T22:52:20.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef80c7700 1 -- 172.21.15.51:0/2229286134 >> 172.21.15.51:0/2229286134 conn(0x7fbef0099460 msgr2=0x7fbef0099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:20.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef80c7700 1 -- 172.21.15.51:0/2229286134 shutdown_connections 2021-02-06T22:52:20.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.482+0000 7fbef80c7700 1 -- 172.21.15.51:0/2229286134 wait complete. 2021-02-06T22:52:20.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 librados: starting msgr at 2021-02-06T22:52:20.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 librados: starting objecter 2021-02-06T22:52:20.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 Processor -- start 2021-02-06T22:52:20.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 -- start start 2021-02-06T22:52:20.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 librados: setting wanted keys 2021-02-06T22:52:20.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 librados: calling monclient init 2021-02-06T22:52:20.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef0067270 con 0x7fbef0092c50 2021-02-06T22:52:20.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef0114b00 con 0x7fbef008f600 2021-02-06T22:52:20.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef80c7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef0067e60 con 0x7fbef012cef0 2021-02-06T22:52:20.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef5662700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fbef0092c50 0x7fbef013ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59238/0 (socket says 172.21.15.51:59238) 2021-02-06T22:52:20.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.483+0000 7fbef5662700 1 -- 172.21.15.51:0/4225207391 learned_addr learned my addr 172.21.15.51:0/4225207391 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:20.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbef5662700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.51:6789/0 conn(0x7fbef0092c50 legacy=0x7fbef013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbef6664700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.51:6790/0 conn(0x7fbef012cef0 legacy=0x7fbef01423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter ms_handle_connect 0x7fbef0092c50 2021-02-06T22:52:20.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter ms_handle_connect 0x7fbef012cef0 2021-02-06T22:52:20.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913278391 0 0) 0x7fbef0067270 con 0x7fbef0092c50 2021-02-06T22:52:20.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed0004bd0 con 0x7fbef0092c50 2021-02-06T22:52:20.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302041220 0 0) 0x7fbef0067e60 con 0x7fbef012cef0 2021-02-06T22:52:20.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef0067270 con 0x7fbef012cef0 2021-02-06T22:52:20.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter ms_handle_connect 0x7fbef008f600 2021-02-06T22:52:20.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:20.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbef5e63700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.106:6789/0 conn(0x7fbef008f600 legacy=0x7fbef01260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:20.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2670360999 0 0) 0x7fbef0067270 con 0x7fbef012cef0 2021-02-06T22:52:20.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbef0067e60 con 0x7fbef012cef0 2021-02-06T22:52:20.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbee8001c70 con 0x7fbef012cef0 2021-02-06T22:52:20.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1857257968 0 0) 0x7fbed0004bd0 con 0x7fbef0092c50 2021-02-06T22:52:20.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbef0067270 con 0x7fbef0092c50 2021-02-06T22:52:20.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982065428 0 0) 0x7fbef0114b00 con 0x7fbef008f600 2021-02-06T22:52:20.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed0004bd0 con 0x7fbef008f600 2021-02-06T22:52:20.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbeec001990 con 0x7fbef0092c50 2021-02-06T22:52:20.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3334222262 0 0) 0x7fbef0067e60 con 0x7fbef012cef0 2021-02-06T22:52:20.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.106:6789/0 conn(0x7fbef008f600 legacy=0x7fbef01260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.51:6789/0 conn(0x7fbef0092c50 legacy=0x7fbef013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:20.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef0066ad0 con 0x7fbef012cef0 2021-02-06T22:52:20.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef01267c0 con 0x7fbef012cef0 2021-02-06T22:52:20.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbee8005120 con 0x7fbef012cef0 2021-02-06T22:52:20.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.486+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbee8005430 con 0x7fbef012cef0 2021-02-06T22:52:20.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbef80c7700 10 client.4175.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:20.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef0065b40 con 0x7fbef012cef0 2021-02-06T22:52:20.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbef80c7700 1 librados: init done 2021-02-06T22:52:20.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fbee800dbf0 con 0x7fbef012cef0 2021-02-06T22:52:20.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(12..12 src has 1..12) v4 ==== 2796+0+0 (unknown 1128074852 0 0) 0x7fbee8039730 con 0x7fbef012cef0 2021-02-06T22:52:20.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 10 client.4175.objecter ms_dispatch 0x7fbef0001510 osd_map(12..12 src has 1..12) v4 2021-02-06T22:52:20.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 3 client.4175.objecter handle_osd_map got epochs [12,12] > 0 2021-02-06T22:52:20.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 3 client.4175.objecter handle_osd_map decoding full epoch 12 2021-02-06T22:52:20.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.487+0000 7fbeddffb700 20 client.4175.objecter dump_active .. 0 homeless 2021-02-06T22:52:20.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.488+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef00581b0 con 0x7fbef012cef0 2021-02-06T22:52:20.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.490+0000 7fbeddffb700 10 client.4175.objecter ms_handle_connect 0x7fbed0030820 2021-02-06T22:52:20.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.492+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fbee8012840 con 0x7fbef012cef0 2021-02-06T22:52:20.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:20.673+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbef0090bd0 con 0x7fbef012cef0 2021-02-06T22:52:21.207 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:21.207+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:21.208 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:21.207+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:21.208 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:21.208 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:21.208 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:21.208 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:21.209 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:21.209 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:21.209 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:21.209 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:21.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.402+0000 7fbeddffb700 1 -- 172.21.15.51:0/4225207391 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (unknown 2984082091 0 0) 0x7fbee8012430 con 0x7fbef012cef0 2021-02-06T22:52:21.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.404+0000 7fbef80c7700 10 librados: watch_flush enter 2021-02-06T22:52:21.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.404+0000 7fbef80c7700 10 librados: watch_flush exit 2021-02-06T22:52:21.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.404+0000 7fbef80c7700 20 client.4175.objecter shutdown clearing up homeless session... 2021-02-06T22:52:21.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.404+0000 7fbef80c7700 10 client.4175.objecter successfully canceled tick 2021-02-06T22:52:21.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.404+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.106:6812/33219 conn(0x7fbed0030820 legacy=0x7fbed0032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 >> v1:172.21.15.51:6790/0 conn(0x7fbef012cef0 legacy=0x7fbef01423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 shutdown_connections 2021-02-06T22:52:21.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 >> 172.21.15.51:0/4225207391 conn(0x7fbef0099460 msgr2=0x7fbef012c080 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:21.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 shutdown_connections 2021-02-06T22:52:21.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 -- 172.21.15.51:0/4225207391 wait complete. 2021-02-06T22:52:21.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.405+0000 7fbef80c7700 1 librados: shutdown 2021-02-06T22:52:21.406 INFO:teuthology.orchestra.run.smithi051.stderr:pool 'rbd' created 2021-02-06T22:52:21.418 DEBUG:teuthology.orchestra.run.smithi051:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-06T22:52:21.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.549+0000 7f4e9a381700 1 Processor -- start 2021-02-06T22:52:21.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9a381700 1 -- start start 2021-02-06T22:52:21.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9a381700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9408fc30 con 0x7f4e94093490 2021-02-06T22:52:21.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9a381700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94091b20 con 0x7f4e94094d50 2021-02-06T22:52:21.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9a381700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94091dc0 con 0x7f4e94092420 2021-02-06T22:52:21.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9891e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 0x7f4e9412fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59606/0 (socket says 172.21.15.51:59606) 2021-02-06T22:52:21.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e937fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4e94093490 0x7f4e9408f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59268/0 (socket says 172.21.15.51:59268) 2021-02-06T22:52:21.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.550+0000 7f4e9891e700 1 -- 172.21.15.51:0/2323471834 learned_addr learned my addr 172.21.15.51:0/2323471834 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:21.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.552+0000 7f4e937fe700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.51:6789/0 conn(0x7f4e94093490 legacy=0x7f4e9408f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.552+0000 7f4e9891e700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 legacy=0x7f4e9412fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e93fff700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.106:6789/0 conn(0x7f4e94094d50 legacy=0x7f4e9408ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863095103 0 0) 0x7f4e94091dc0 con 0x7f4e94092420 2021-02-06T22:52:21.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e80003230 con 0x7f4e94092420 2021-02-06T22:52:21.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174237908 0 0) 0x7f4e9408fc30 con 0x7f4e94093490 2021-02-06T22:52:21.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e94091dc0 con 0x7f4e94093490 2021-02-06T22:52:21.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 259775892 0 0) 0x7f4e80003230 con 0x7f4e94092420 2021-02-06T22:52:21.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.106:6789/0 conn(0x7f4e94094d50 legacy=0x7f4e9408ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.51:6789/0 conn(0x7f4e94093490 legacy=0x7f4e9408f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94092060 con 0x7f4e94092420 2021-02-06T22:52:21.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e8c001cb0 con 0x7f4e94092420 2021-02-06T22:52:21.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e8c001fc0 con 0x7f4e94092420 2021-02-06T22:52:21.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e92ffd700 1 -- 172.21.15.51:0/2323471834 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e8c004ad0 con 0x7f4e94092420 2021-02-06T22:52:21.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e9a381700 1 -- 172.21.15.51:0/2323471834 >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 legacy=0x7f4e9412fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e9a381700 1 -- 172.21.15.51:0/2323471834 shutdown_connections 2021-02-06T22:52:21.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.553+0000 7f4e9a381700 1 -- 172.21.15.51:0/2323471834 >> 172.21.15.51:0/2323471834 conn(0x7f4e94099460 msgr2=0x7f4e94099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:21.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.554+0000 7f4e9a381700 1 -- 172.21.15.51:0/2323471834 shutdown_connections 2021-02-06T22:52:21.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.554+0000 7f4e9a381700 1 -- 172.21.15.51:0/2323471834 wait complete. 2021-02-06T22:52:21.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.554+0000 7f4e9a381700 1 librados: starting msgr at 2021-02-06T22:52:21.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.554+0000 7f4e9a381700 1 librados: starting objecter 2021-02-06T22:52:21.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.554+0000 7f4e9a381700 1 Processor -- start 2021-02-06T22:52:21.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 -- start start 2021-02-06T22:52:21.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 librados: setting wanted keys 2021-02-06T22:52:21.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 librados: calling monclient init 2021-02-06T22:52:21.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e941104c0 con 0x7f4e94093490 2021-02-06T22:52:21.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94110760 con 0x7f4e94094d50 2021-02-06T22:52:21.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e9a381700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e94090c60 con 0x7f4e94092420 2021-02-06T22:52:21.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e93fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 0x7f4e94139a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59612/0 (socket says 172.21.15.51:59612) 2021-02-06T22:52:21.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.555+0000 7f4e93fff700 1 -- 172.21.15.51:0/492727492 learned_addr learned my addr 172.21.15.51:0/492727492 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:21.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e93fff700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 legacy=0x7f4e94139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 10 client.?.objecter ms_handle_connect 0x7f4e94092420 2021-02-06T22:52:21.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e937fe700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.51:6789/0 conn(0x7f4e94093490 legacy=0x7f4e9413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:21.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 10 client.?.objecter ms_handle_connect 0x7f4e94093490 2021-02-06T22:52:21.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:21.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147425635 0 0) 0x7f4e941104c0 con 0x7f4e94093490 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e74004bd0 con 0x7f4e94093490 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075822653 0 0) 0x7f4e94090c60 con 0x7f4e94092420 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.557+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e941104c0 con 0x7f4e94092420 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 10 client.?.objecter ms_handle_connect 0x7f4e94094d50 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:21.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e9891e700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.106:6789/0 conn(0x7f4e94094d50 legacy=0x7f4e94141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:21.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3612422883 0 0) 0x7f4e74004bd0 con 0x7f4e94093490 2021-02-06T22:52:21.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e94090c60 con 0x7f4e94093490 2021-02-06T22:52:21.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e88001990 con 0x7f4e94093490 2021-02-06T22:52:21.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 556178271 0 0) 0x7f4e941104c0 con 0x7f4e94092420 2021-02-06T22:52:21.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e74004bd0 con 0x7f4e94092420 2021-02-06T22:52:21.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251859781 0 0) 0x7f4e94110760 con 0x7f4e94094d50 2021-02-06T22:52:21.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e941104c0 con 0x7f4e94094d50 2021-02-06T22:52:21.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e84001c70 con 0x7f4e94092420 2021-02-06T22:52:21.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2056168824 0 0) 0x7f4e94090c60 con 0x7f4e94093490 2021-02-06T22:52:21.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.51:6790/0 conn(0x7f4e94092420 legacy=0x7f4e94139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.106:6789/0 conn(0x7f4e94094d50 legacy=0x7f4e94141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:21.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e94066620 con 0x7f4e94093490 2021-02-06T22:52:21.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e940672b0 con 0x7f4e94093490 2021-02-06T22:52:21.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e9a381700 10 client.4194.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:21.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e94126270 con 0x7f4e94093490 2021-02-06T22:52:21.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e9a381700 1 librados: init done 2021-02-06T22:52:21.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e880048b0 con 0x7f4e94093490 2021-02-06T22:52:21.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.558+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e88004bc0 con 0x7f4e94093490 2021-02-06T22:52:21.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4e88004da0 con 0x7f4e94093490 2021-02-06T22:52:21.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(13..13 src has 1..13) v4 ==== 3138+0+0 (unknown 2929962713 0 0) 0x7f4e88039570 con 0x7f4e94093490 2021-02-06T22:52:21.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 10 client.4194.objecter ms_dispatch 0x7f4e94001510 osd_map(13..13 src has 1..13) v4 2021-02-06T22:52:21.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 3 client.4194.objecter handle_osd_map got epochs [13,13] > 0 2021-02-06T22:52:21.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 3 client.4194.objecter handle_osd_map decoding full epoch 13 2021-02-06T22:52:21.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c004d60 con 0x7f4e94093490 2021-02-06T22:52:21.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.559+0000 7f4e7bfff700 20 client.4194.objecter dump_active .. 0 homeless 2021-02-06T22:52:21.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.561+0000 7f4e7bfff700 10 client.4194.objecter ms_handle_connect 0x7f4e74030740 2021-02-06T22:52:21.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.563+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4e88012470 con 0x7f4e94093490 2021-02-06T22:52:21.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:21.754+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4e6c0059b0 con 0x7f4e94093490 2021-02-06T22:52:22.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.212+0000 7f4e7bfff700 1 -- 172.21.15.51:0/492727492 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (unknown 3289125425 0 0) 0x7f4e88012060 con 0x7f4e94093490 2021-02-06T22:52:22.213 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:22.213+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:22.214 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:22.213+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:22.214 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:22.214 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:22.214 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:22.215 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:22.215 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:22.215 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:22.215 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:22.215 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:22.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.215+0000 7f4e9a381700 10 librados: watch_flush enter 2021-02-06T22:52:22.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.215+0000 7f4e9a381700 10 librados: watch_flush exit 2021-02-06T22:52:22.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.215+0000 7f4e9a381700 20 client.4194.objecter shutdown clearing up homeless session... 2021-02-06T22:52:22.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.215+0000 7f4e9a381700 10 client.4194.objecter successfully canceled tick 2021-02-06T22:52:22.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.216+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.106:6812/33219 conn(0x7f4e74030740 legacy=0x7f4e74032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.216+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 >> v1:172.21.15.51:6789/0 conn(0x7f4e94093490 legacy=0x7f4e9413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.217+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 shutdown_connections 2021-02-06T22:52:22.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.217+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 >> 172.21.15.51:0/492727492 conn(0x7f4e94099460 msgr2=0x7f4e94093c40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:22.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.217+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 shutdown_connections 2021-02-06T22:52:22.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.218+0000 7f4e9a381700 1 -- 172.21.15.51:0/492727492 wait complete. 2021-02-06T22:52:22.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.218+0000 7f4e9a381700 1 librados: shutdown 2021-02-06T22:52:22.219 INFO:teuthology.orchestra.run.smithi051.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-06T22:52:22.232 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2021-02-06T22:52:22.233 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-06T22:52:22.233 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-02-06T22:52:22.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.361+0000 7fc52aeb9700 1 Processor -- start 2021-02-06T22:52:22.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.361+0000 7fc52aeb9700 1 -- start start 2021-02-06T22:52:22.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc52aeb9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc524095440 con 0x7fc52412ce00 2021-02-06T22:52:22.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc52aeb9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240907b0 con 0x7fc524092bf0 2021-02-06T22:52:22.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc52aeb9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc524091010 con 0x7fc52408fa70 2021-02-06T22:52:22.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc528c55700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 0x7fc5240921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59628/0 (socket says 172.21.15.51:59628) 2021-02-06T22:52:22.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc528c55700 1 -- 172.21.15.51:0/582382214 learned_addr learned my addr 172.21.15.51:0/582382214 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:22.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.362+0000 7fc529456700 1 --1- 172.21.15.51:0/582382214 >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 0x7fc52412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59290/0 (socket says 172.21.15.51:59290) 2021-02-06T22:52:22.365 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.364+0000 7fc528c55700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 legacy=0x7fc5240921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.365 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.364+0000 7fc529456700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 legacy=0x7fc52412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.364+0000 7fc523fff700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.106:6789/0 conn(0x7fc524092bf0 legacy=0x7fc5240930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456376811 0 0) 0x7fc524095440 con 0x7fc52412ce00 2021-02-06T22:52:22.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc508003230 con 0x7fc52412ce00 2021-02-06T22:52:22.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626847810 0 0) 0x7fc524091010 con 0x7fc52408fa70 2021-02-06T22:52:22.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc524095440 con 0x7fc52408fa70 2021-02-06T22:52:22.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349219092 0 0) 0x7fc5240907b0 con 0x7fc524092bf0 2021-02-06T22:52:22.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc524091010 con 0x7fc524092bf0 2021-02-06T22:52:22.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1493548487 0 0) 0x7fc508003230 con 0x7fc52412ce00 2021-02-06T22:52:22.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 legacy=0x7fc5240921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.106:6789/0 conn(0x7fc524092bf0 legacy=0x7fc5240930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240912b0 con 0x7fc52412ce00 2021-02-06T22:52:22.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc51c001ca0 con 0x7fc52412ce00 2021-02-06T22:52:22.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc51c001fc0 con 0x7fc52412ce00 2021-02-06T22:52:22.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc5237fe700 1 -- 172.21.15.51:0/582382214 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc51c004a10 con 0x7fc52412ce00 2021-02-06T22:52:22.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc52aeb9700 1 -- 172.21.15.51:0/582382214 >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 legacy=0x7fc52412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc52aeb9700 1 -- 172.21.15.51:0/582382214 shutdown_connections 2021-02-06T22:52:22.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.365+0000 7fc52aeb9700 1 -- 172.21.15.51:0/582382214 >> 172.21.15.51:0/582382214 conn(0x7fc524096860 msgr2=0x7fc524099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:22.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.366+0000 7fc52aeb9700 1 -- 172.21.15.51:0/582382214 shutdown_connections 2021-02-06T22:52:22.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.366+0000 7fc52aeb9700 1 -- 172.21.15.51:0/582382214 wait complete. 2021-02-06T22:52:22.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.366+0000 7fc52aeb9700 1 librados: starting msgr at 2021-02-06T22:52:22.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.366+0000 7fc52aeb9700 1 librados: starting objecter 2021-02-06T22:52:22.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.366+0000 7fc52aeb9700 1 Processor -- start 2021-02-06T22:52:22.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 -- start start 2021-02-06T22:52:22.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 librados: setting wanted keys 2021-02-06T22:52:22.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 librados: calling monclient init 2021-02-06T22:52:22.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc524098150 con 0x7fc52412ce00 2021-02-06T22:52:22.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5240674a0 con 0x7fc524092bf0 2021-02-06T22:52:22.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc52aeb9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc524127b90 con 0x7fc52408fa70 2021-02-06T22:52:22.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc528c55700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 0x7fc524066680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59634/0 (socket says 172.21.15.51:59634) 2021-02-06T22:52:22.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc529456700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 0x7fc524141ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59294/0 (socket says 172.21.15.51:59294) 2021-02-06T22:52:22.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.367+0000 7fc528c55700 1 -- 172.21.15.51:0/4163790725 learned_addr learned my addr 172.21.15.51:0/4163790725 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:22.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc529456700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 legacy=0x7fc524141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc528c55700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 legacy=0x7fc524066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc520ff9700 10 client.?.objecter ms_handle_connect 0x7fc52412ce00 2021-02-06T22:52:22.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc520ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc520ff9700 10 client.?.objecter ms_handle_connect 0x7fc52408fa70 2021-02-06T22:52:22.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc520ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc528c55700 1 --1- 172.21.15.51:0/4163790725 >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 0x7fc524066680 :-1 s=OPENED pgs=58 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fc524127b90 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:52:22.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.369+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430574967 0 0) 0x7fc524098150 con 0x7fc52412ce00 2021-02-06T22:52:22.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc523fff700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.106:6789/0 conn(0x7fc524092bf0 legacy=0x7fc524066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc504004bd0 con 0x7fc52412ce00 2021-02-06T22:52:22.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 10 client.?.objecter ms_handle_connect 0x7fc524092bf0 2021-02-06T22:52:22.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3026712671 0 0) 0x7fc504004bd0 con 0x7fc52412ce00 2021-02-06T22:52:22.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc524098150 con 0x7fc52412ce00 2021-02-06T22:52:22.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc51c004a10 con 0x7fc52412ce00 2021-02-06T22:52:22.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010253013 0 0) 0x7fc5240674a0 con 0x7fc524092bf0 2021-02-06T22:52:22.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc504004bd0 con 0x7fc524092bf0 2021-02-06T22:52:22.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 612446195 0 0) 0x7fc524098150 con 0x7fc52412ce00 2021-02-06T22:52:22.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.51:6790/0 conn(0x7fc52408fa70 legacy=0x7fc524066680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.106:6789/0 conn(0x7fc524092bf0 legacy=0x7fc524066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5241270c0 con 0x7fc52412ce00 2021-02-06T22:52:22.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130961966 0 0) 0x7fc524127b90 con 0x7fc52408fa70 2021-02-06T22:52:22.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5241266c0 con 0x7fc52412ce00 2021-02-06T22:52:22.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc52aeb9700 10 client.4200.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:22.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc524125020 con 0x7fc52412ce00 2021-02-06T22:52:22.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc52aeb9700 1 librados: init done 2021-02-06T22:52:22.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc51c001810 con 0x7fc52412ce00 2021-02-06T22:52:22.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.370+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc51c0051d0 con 0x7fc52412ce00 2021-02-06T22:52:22.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fc51c00d990 con 0x7fc52412ce00 2021-02-06T22:52:22.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3149+0+0 (unknown 3693635034 0 0) 0x7fc51c039870 con 0x7fc52412ce00 2021-02-06T22:52:22.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 10 client.4200.objecter ms_dispatch 0x7fc524001510 osd_map(14..14 src has 1..14) v4 2021-02-06T22:52:22.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 3 client.4200.objecter handle_osd_map got epochs [14,14] > 0 2021-02-06T22:52:22.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 3 client.4200.objecter handle_osd_map decoding full epoch 14 2021-02-06T22:52:22.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4fc004d60 con 0x7fc52412ce00 2021-02-06T22:52:22.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.371+0000 7fc520ff9700 20 client.4200.objecter dump_active .. 0 homeless 2021-02-06T22:52:22.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.374+0000 7fc520ff9700 10 client.4200.objecter ms_handle_connect 0x7fc504030470 2021-02-06T22:52:22.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.375+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fc51c012820 con 0x7fc52412ce00 2021-02-06T22:52:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.557+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4fc005430 con 0x7fc52412ce00 2021-02-06T22:52:22.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.558+0000 7fc520ff9700 1 -- 172.21.15.51:0/4163790725 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8454 (unknown 92231148 0 2024047191) 0x7fc51c012410 con 0x7fc52412ce00 2021-02-06T22:52:22.557 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:22.558 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":14,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:22.206721+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-06T22:52:20.713249+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:52:22.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 10 librados: watch_flush enter 2021-02-06T22:52:22.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 10 librados: watch_flush exit 2021-02-06T22:52:22.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 20 client.4200.objecter shutdown clearing up homeless session... 2021-02-06T22:52:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 10 client.4200.objecter successfully canceled tick 2021-02-06T22:52:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.106:6812/33219 conn(0x7fc504030470 legacy=0x7fc504032930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 >> v1:172.21.15.51:6789/0 conn(0x7fc52412ce00 legacy=0x7fc524141ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 shutdown_connections 2021-02-06T22:52:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 >> 172.21.15.51:0/4163790725 conn(0x7fc524096860 msgr2=0x7fc524093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 shutdown_connections 2021-02-06T22:52:22.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 -- 172.21.15.51:0/4163790725 wait complete. 2021-02-06T22:52:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.559+0000 7fc52aeb9700 1 librados: shutdown 2021-02-06T22:52:22.570 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-06T22:52:20.713249+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-06T22:52:22.571 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2021-02-06T22:52:22.695 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.696+0000 7f73b5af9700 1 Processor -- start 2021-02-06T22:52:22.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.696+0000 7f73b5af9700 1 -- start start 2021-02-06T22:52:22.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73b5af9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b0095020 con 0x7f73b008f390 2021-02-06T22:52:22.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73b5af9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00952c0 con 0x7f73b008f840 2021-02-06T22:52:22.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73b5af9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b0095560 con 0x7f73b0092a20 2021-02-06T22:52:22.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73aeffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 0x7f73b012d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59300/0 (socket says 172.21.15.51:59300) 2021-02-06T22:52:22.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73af7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f73b0092a20 0x7f73b008ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59642/0 (socket says 172.21.15.51:59642) 2021-02-06T22:52:22.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.697+0000 7f73aeffd700 1 -- 172.21.15.51:0/1354530925 learned_addr learned my addr 172.21.15.51:0/1354530925 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:22.700 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73af7fe700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.51:6790/0 conn(0x7f73b0092a20 legacy=0x7f73b008ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.701 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73aeffd700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 legacy=0x7f73b012d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.701 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676663891 0 0) 0x7f73b0095560 con 0x7f73b0092a20 2021-02-06T22:52:22.701 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f739c003230 con 0x7f73b0092a20 2021-02-06T22:52:22.702 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863758026 0 0) 0x7f73b0095020 con 0x7f73b008f390 2021-02-06T22:52:22.702 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b0095560 con 0x7f73b008f390 2021-02-06T22:52:22.702 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73affff700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.106:6789/0 conn(0x7f73b008f840 legacy=0x7f73b0130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.702 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3329250263 0 0) 0x7f739c003230 con 0x7f73b0092a20 2021-02-06T22:52:22.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.106:6789/0 conn(0x7f73b008f840 legacy=0x7f73b0130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 legacy=0x7f73b012d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0068250 con 0x7f73b0092a20 2021-02-06T22:52:22.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.699+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f73a0001970 con 0x7f73b0092a20 2021-02-06T22:52:22.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73af7fe700 1 --1- 172.21.15.51:0/1354530925 >> v1:172.21.15.51:6790/0 conn(0x7f73b0092a20 0x7f73b008ec80 :-1 s=OPENED pgs=59 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f73a0004690 mon_map magic: 0 v1 2021-02-06T22:52:22.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f73a0001c80 con 0x7f73b0092a20 2021-02-06T22:52:22.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73b5af9700 1 -- 172.21.15.51:0/1354530925 >> v1:172.21.15.51:6790/0 conn(0x7f73b0092a20 legacy=0x7f73b008ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73ae7fc700 1 -- 172.21.15.51:0/1354530925 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f73a0004690 con 0x7f73b0092a20 2021-02-06T22:52:22.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73b5af9700 1 -- 172.21.15.51:0/1354530925 shutdown_connections 2021-02-06T22:52:22.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73b5af9700 1 -- 172.21.15.51:0/1354530925 >> 172.21.15.51:0/1354530925 conn(0x7f73b0099460 msgr2=0x7f73b0099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:22.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73b5af9700 1 -- 172.21.15.51:0/1354530925 shutdown_connections 2021-02-06T22:52:22.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.700+0000 7f73b5af9700 1 -- 172.21.15.51:0/1354530925 wait complete. 2021-02-06T22:52:22.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 librados: starting msgr at 2021-02-06T22:52:22.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 librados: starting objecter 2021-02-06T22:52:22.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 Processor -- start 2021-02-06T22:52:22.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 -- start start 2021-02-06T22:52:22.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 librados: setting wanted keys 2021-02-06T22:52:22.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 librados: calling monclient init 2021-02-06T22:52:22.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.701+0000 7f73b5af9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b01108f0 con 0x7f73b008f390 2021-02-06T22:52:22.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.702+0000 7f73b5af9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00947b0 con 0x7f73b0092a20 2021-02-06T22:52:22.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.702+0000 7f73b5af9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00922e0 con 0x7f73b008f840 2021-02-06T22:52:22.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.702+0000 7f73af7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 0x7f73b0090e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59306/0 (socket says 172.21.15.51:59306) 2021-02-06T22:52:22.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.702+0000 7f73aeffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f73b008f840 0x7f73b011ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59646/0 (socket says 172.21.15.51:59646) 2021-02-06T22:52:22.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.702+0000 7f73af7fe700 1 -- 172.21.15.51:0/921886562 learned_addr learned my addr 172.21.15.51:0/921886562 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:22.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73af7fe700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 legacy=0x7f73b0090e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73aeffd700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.51:6790/0 conn(0x7f73b008f840 legacy=0x7f73b011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter ms_handle_connect 0x7f73b008f390 2021-02-06T22:52:22.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter ms_handle_connect 0x7f73b008f840 2021-02-06T22:52:22.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380168084 0 0) 0x7f73b01108f0 con 0x7f73b008f390 2021-02-06T22:52:22.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73affff700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.106:6789/0 conn(0x7f73b0092a20 legacy=0x7f73b0141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:22.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7390004bd0 con 0x7f73b008f390 2021-02-06T22:52:22.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter ms_handle_connect 0x7f73b0092a20 2021-02-06T22:52:22.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:22.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823107143 0 0) 0x7f73b00922e0 con 0x7f73b008f840 2021-02-06T22:52:22.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b01108f0 con 0x7f73b008f840 2021-02-06T22:52:22.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484290218 0 0) 0x7f73b00947b0 con 0x7f73b0092a20 2021-02-06T22:52:22.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b00922e0 con 0x7f73b0092a20 2021-02-06T22:52:22.715 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1836431779 0 0) 0x7f7390004bd0 con 0x7f73b008f390 2021-02-06T22:52:22.715 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f73b00947b0 con 0x7f73b008f390 2021-02-06T22:52:22.715 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f73a00017d0 con 0x7f73b008f390 2021-02-06T22:52:22.715 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 674773366 0 0) 0x7f73b01108f0 con 0x7f73b008f840 2021-02-06T22:52:22.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7390004bd0 con 0x7f73b008f840 2021-02-06T22:52:22.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f73a4001be0 con 0x7f73b008f840 2021-02-06T22:52:22.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 169972791 0 0) 0x7f73b00947b0 con 0x7f73b008f390 2021-02-06T22:52:22.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.51:6790/0 conn(0x7f73b008f840 legacy=0x7f73b011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.106:6789/0 conn(0x7f73b0092a20 legacy=0x7f73b0141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b01211f0 con 0x7f73b008f390 2021-02-06T22:52:22.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.704+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b01214a0 con 0x7f73b008f390 2021-02-06T22:52:22.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73b5af9700 10 client.4206.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:22.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b011b780 con 0x7f73b008f390 2021-02-06T22:52:22.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73b5af9700 1 librados: init done 2021-02-06T22:52:22.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f73a00015a0 con 0x7f73b008f390 2021-02-06T22:52:22.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f73a0004f40 con 0x7f73b008f390 2021-02-06T22:52:22.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f73a000d700 con 0x7f73b008f390 2021-02-06T22:52:22.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.705+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7388004d60 con 0x7f73b008f390 2021-02-06T22:52:22.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.706+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3149+0+0 (unknown 3693635034 0 0) 0x7f73a0039760 con 0x7f73b008f390 2021-02-06T22:52:22.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.706+0000 7f73977fe700 10 client.4206.objecter ms_dispatch 0x7f73b0001510 osd_map(14..14 src has 1..14) v4 2021-02-06T22:52:22.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.706+0000 7f73977fe700 3 client.4206.objecter handle_osd_map got epochs [14,14] > 0 2021-02-06T22:52:22.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.706+0000 7f73977fe700 3 client.4206.objecter handle_osd_map decoding full epoch 14 2021-02-06T22:52:22.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.706+0000 7f73977fe700 20 client.4206.objecter dump_active .. 0 homeless 2021-02-06T22:52:22.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.708+0000 7f73977fe700 10 client.4206.objecter ms_handle_connect 0x7f7390030620 2021-02-06T22:52:22.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.710+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f73a00124e0 con 0x7f73b008f390 2021-02-06T22:52:22.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.890+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73880059b0 con 0x7f73b008f390 2021-02-06T22:52:22.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.891+0000 7f73977fe700 1 -- 172.21.15.51:0/921886562 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (unknown 185327234 0 265718887) 0x7f73a0012300 con 0x7f73b008f390 2021-02-06T22:52:22.891 INFO:teuthology.orchestra.run.smithi051.stdout:pg_num: 8 2021-02-06T22:52:22.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 10 librados: watch_flush enter 2021-02-06T22:52:22.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 10 librados: watch_flush exit 2021-02-06T22:52:22.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 20 client.4206.objecter shutdown clearing up homeless session... 2021-02-06T22:52:22.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 10 client.4206.objecter successfully canceled tick 2021-02-06T22:52:22.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.106:6812/33219 conn(0x7f7390030620 legacy=0x7f7390032ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 >> v1:172.21.15.51:6789/0 conn(0x7f73b008f390 legacy=0x7f73b0090e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:22.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 shutdown_connections 2021-02-06T22:52:22.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 >> 172.21.15.51:0/921886562 conn(0x7f73b0099460 msgr2=0x7f73b0121ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:22.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 shutdown_connections 2021-02-06T22:52:22.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 -- 172.21.15.51:0/921886562 wait complete. 2021-02-06T22:52:22.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:22.892+0000 7f73b5af9700 1 librados: shutdown 2021-02-06T22:52:22.903 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-02-06T22:52:22.904 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2021-02-06T22:52:22.905 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2021-02-06T22:52:23.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.027+0000 7fd846482700 1 Processor -- start 2021-02-06T22:52:23.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd846482700 1 -- start start 2021-02-06T22:52:23.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd846482700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400915d0 con 0x7fd8400999a0 2021-02-06T22:52:23.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd846482700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd840091ac0 con 0x7fd8400629e0 2021-02-06T22:52:23.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd846482700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd840091d60 con 0x7fd8400928d0 2021-02-06T22:52:23.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd844a1f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd8400928d0 0x7fd84012fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59658/0 (socket says 172.21.15.51:59658) 2021-02-06T22:52:23.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd844a1f700 1 -- 172.21.15.51:0/740524056 learned_addr learned my addr 172.21.15.51:0/740524056 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.028+0000 7fd83ffff700 1 --1- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6789/0 conn(0x7fd8400999a0 0x7fd8400907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59312/0 (socket says 172.21.15.51:59312) 2021-02-06T22:52:23.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.030+0000 7fd844a1f700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6790/0 conn(0x7fd8400928d0 legacy=0x7fd84012fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.030+0000 7fd83ffff700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6789/0 conn(0x7fd8400999a0 legacy=0x7fd8400907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604252290 0 0) 0x7fd840091d60 con 0x7fd8400928d0 2021-02-06T22:52:23.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd82c003230 con 0x7fd8400928d0 2021-02-06T22:52:23.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286732041 0 0) 0x7fd8400915d0 con 0x7fd8400999a0 2021-02-06T22:52:23.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd840091d60 con 0x7fd8400999a0 2021-02-06T22:52:23.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83f7fe700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.106:6789/0 conn(0x7fd8400629e0 legacy=0x7fd840090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 138859408 0 0) 0x7fd840091d60 con 0x7fd8400999a0 2021-02-06T22:52:23.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6790/0 conn(0x7fd8400928d0 legacy=0x7fd84012fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.106:6789/0 conn(0x7fd8400629e0 legacy=0x7fd840090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840092000 con 0x7fd8400999a0 2021-02-06T22:52:23.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd834001930 con 0x7fd8400999a0 2021-02-06T22:52:23.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83ffff700 1 --1- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6789/0 conn(0x7fd8400999a0 0x7fd8400907b0 :-1 s=OPENED pgs=67 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fd834004690 mon_map magic: 0 v1 2021-02-06T22:52:23.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd834001c40 con 0x7fd8400999a0 2021-02-06T22:52:23.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd846482700 1 -- 172.21.15.51:0/740524056 >> v1:172.21.15.51:6789/0 conn(0x7fd8400999a0 legacy=0x7fd8400907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd83effd700 1 -- 172.21.15.51:0/740524056 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd834004690 con 0x7fd8400999a0 2021-02-06T22:52:23.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd846482700 1 -- 172.21.15.51:0/740524056 shutdown_connections 2021-02-06T22:52:23.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.031+0000 7fd846482700 1 -- 172.21.15.51:0/740524056 >> 172.21.15.51:0/740524056 conn(0x7fd840096860 msgr2=0x7fd840099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.032+0000 7fd846482700 1 -- 172.21.15.51:0/740524056 shutdown_connections 2021-02-06T22:52:23.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.032+0000 7fd846482700 1 -- 172.21.15.51:0/740524056 wait complete. 2021-02-06T22:52:23.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.032+0000 7fd846482700 1 librados: starting msgr at 2021-02-06T22:52:23.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.032+0000 7fd846482700 1 librados: starting objecter 2021-02-06T22:52:23.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.032+0000 7fd846482700 1 Processor -- start 2021-02-06T22:52:23.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 -- start start 2021-02-06T22:52:23.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 librados: setting wanted keys 2021-02-06T22:52:23.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 librados: calling monclient init 2021-02-06T22:52:23.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd840130af0 con 0x7fd8400629e0 2021-02-06T22:52:23.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84012e9c0 con 0x7fd8400928d0 2021-02-06T22:52:23.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd846482700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84012ec60 con 0x7fd8400999a0 2021-02-06T22:52:23.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd83ffff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd8400629e0 0x7fd8401303e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59318/0 (socket says 172.21.15.51:59318) 2021-02-06T22:52:23.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd844a1f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd8400999a0 0x7fd840141cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59664/0 (socket says 172.21.15.51:59664) 2021-02-06T22:52:23.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.033+0000 7fd83ffff700 1 -- 172.21.15.51:0/368180730 learned_addr learned my addr 172.21.15.51:0/368180730 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd844a1f700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.51:6790/0 conn(0x7fd8400999a0 legacy=0x7fd840141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter ms_handle_connect 0x7fd8400999a0 2021-02-06T22:52:23.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter ms_handle_connect 0x7fd8400629e0 2021-02-06T22:52:23.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd83ffff700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.51:6789/0 conn(0x7fd8400629e0 legacy=0x7fd8401303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter ms_handle_connect 0x7fd8400928d0 2021-02-06T22:52:23.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd827fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.035+0000 7fd83f7fe700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.106:6789/0 conn(0x7fd8400928d0 legacy=0x7fd84013e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926705726 0 0) 0x7fd84012ec60 con 0x7fd8400999a0 2021-02-06T22:52:23.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd820004bd0 con 0x7fd8400999a0 2021-02-06T22:52:23.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 533139155 0 0) 0x7fd840092000 con 0x7fd8400629e0 2021-02-06T22:52:23.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd84012ec60 con 0x7fd8400629e0 2021-02-06T22:52:23.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517063361 0 0) 0x7fd84012e9c0 con 0x7fd8400928d0 2021-02-06T22:52:23.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd840092000 con 0x7fd8400928d0 2021-02-06T22:52:23.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1591417851 0 0) 0x7fd84012ec60 con 0x7fd8400629e0 2021-02-06T22:52:23.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd84012e9c0 con 0x7fd8400629e0 2021-02-06T22:52:23.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd8340012e0 con 0x7fd8400629e0 2021-02-06T22:52:23.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3898532650 0 0) 0x7fd820004bd0 con 0x7fd8400999a0 2021-02-06T22:52:23.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd84012ec60 con 0x7fd8400999a0 2021-02-06T22:52:23.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd838001d30 con 0x7fd8400999a0 2021-02-06T22:52:23.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2134443658 0 0) 0x7fd840092000 con 0x7fd8400928d0 2021-02-06T22:52:23.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd820004bd0 con 0x7fd8400928d0 2021-02-06T22:52:23.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd830001af0 con 0x7fd8400928d0 2021-02-06T22:52:23.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 326234343 0 0) 0x7fd84012e9c0 con 0x7fd8400629e0 2021-02-06T22:52:23.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.51:6790/0 conn(0x7fd8400999a0 legacy=0x7fd840141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.106:6789/0 conn(0x7fd8400928d0 legacy=0x7fd84013e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84012d5d0 con 0x7fd8400629e0 2021-02-06T22:52:23.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd840094940 con 0x7fd8400629e0 2021-02-06T22:52:23.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd846482700 10 client.4212.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:23.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd840094140 con 0x7fd8400629e0 2021-02-06T22:52:23.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd846482700 1 librados: init done 2021-02-06T22:52:23.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd834004e30 con 0x7fd8400629e0 2021-02-06T22:52:23.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.036+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd834005140 con 0x7fd8400629e0 2021-02-06T22:52:23.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fd83400d900 con 0x7fd8400629e0 2021-02-06T22:52:23.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 3149+0+0 (unknown 3693635034 0 0) 0x7fd834039550 con 0x7fd8400629e0 2021-02-06T22:52:23.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 10 client.4212.objecter ms_dispatch 0x7fd840001510 osd_map(14..14 src has 1..14) v4 2021-02-06T22:52:23.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 3 client.4212.objecter handle_osd_map got epochs [14,14] > 0 2021-02-06T22:52:23.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 3 client.4212.objecter handle_osd_map decoding full epoch 14 2021-02-06T22:52:23.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd827fff700 20 client.4212.objecter dump_active .. 0 homeless 2021-02-06T22:52:23.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.037+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd818004d60 con 0x7fd8400629e0 2021-02-06T22:52:23.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.040+0000 7fd827fff700 10 client.4212.objecter ms_handle_connect 0x7fd8200307d0 2021-02-06T22:52:23.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.041+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd834012500 con 0x7fd8400629e0 2021-02-06T22:52:23.229 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:23.229+0000 7f3309baa700 -1 mgr notify devicehealth.notify: 2021-02-06T22:52:23.229 INFO:tasks.ceph.mgr.x.smithi106.stderr:2021-02-06T22:52:23.229+0000 7f3309baa700 -1 mgr notify Traceback (most recent call last): 2021-02-06T22:52:23.229 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 217, in notify 2021-02-06T22:52:23.230 INFO:tasks.ceph.mgr.x.smithi106.stderr: self.maybe_create_device_pool() 2021-02-06T22:52:23.230 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 231, in maybe_create_device_pool 2021-02-06T22:52:23.230 INFO:tasks.ceph.mgr.x.smithi106.stderr: if not self.have_enough_osds(): 2021-02-06T22:52:23.230 INFO:tasks.ceph.mgr.x.smithi106.stderr: File "/usr/share/ceph/mgr/devicehealth/module.py", line 226, in have_enough_osds 2021-02-06T22:52:23.230 INFO:tasks.ceph.mgr.x.smithi106.stderr: need = cast(int, self.get_ceph_option("osd_pool_default_size")) 2021-02-06T22:52:23.231 INFO:tasks.ceph.mgr.x.smithi106.stderr:NameError: name 'cast' is not defined 2021-02-06T22:52:23.231 INFO:tasks.ceph.mgr.x.smithi106.stderr: 2021-02-06T22:52:23.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.272+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd818005430 con 0x7fd8400629e0 2021-02-06T22:52:23.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.273+0000 7fd827fff700 1 -- 172.21.15.51:0/368180730 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+69016 (unknown 3797009233 0 4118999149) 0x7fd8340120f0 con 0x7fd8400629e0 2021-02-06T22:52:23.273 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:23.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 10 librados: watch_flush enter 2021-02-06T22:52:23.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 10 librados: watch_flush exit 2021-02-06T22:52:23.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 20 client.4212.objecter shutdown clearing up homeless session... 2021-02-06T22:52:23.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 10 client.4212.objecter successfully canceled tick 2021-02-06T22:52:23.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.106:6812/33219 conn(0x7fd8200307d0 legacy=0x7fd820032c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 >> v1:172.21.15.51:6789/0 conn(0x7fd8400629e0 legacy=0x7fd8401303e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 shutdown_connections 2021-02-06T22:52:23.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 >> 172.21.15.51:0/368180730 conn(0x7fd840096860 msgr2=0x7fd840129f10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 shutdown_connections 2021-02-06T22:52:23.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 -- 172.21.15.51:0/368180730 wait complete. 2021-02-06T22:52:23.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.275+0000 7fd846482700 1 librados: shutdown 2021-02-06T22:52:23.285 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":4,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6812","nonce":33219}]},"active_addr":"172.21.15.106:6812/33219","active_change":"2021-02-06T22:52:14.627723+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3754572995}]},{"addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":987967662}]}]}} 2021-02-06T22:52:23.288 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2021-02-06T22:52:23.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2021-02-06T22:52:23.288 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-06T22:52:23.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.410+0000 7fb1ab142700 1 Processor -- start 2021-02-06T22:52:23.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1ab142700 1 -- start start 2021-02-06T22:52:23.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1ab142700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4095440 con 0x7fb1a4092bf0 2021-02-06T22:52:23.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1ab142700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a40907b0 con 0x7fb1a412ce00 2021-02-06T22:52:23.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1ab142700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4091010 con 0x7fb1a408fa70 2021-02-06T22:52:23.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1a3fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb1a4092bf0 0x7fb1a40930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59326/0 (socket says 172.21.15.51:59326) 2021-02-06T22:52:23.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1a3fff700 1 -- 172.21.15.51:0/4129735164 learned_addr learned my addr 172.21.15.51:0/4129735164 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.411+0000 7fb1a8ede700 1 --1- 172.21.15.51:0/4129735164 >> v1:172.21.15.51:6790/0 conn(0x7fb1a408fa70 0x7fb1a40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59668/0 (socket says 172.21.15.51:59668) 2021-02-06T22:52:23.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.413+0000 7fb1a3fff700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.51:6789/0 conn(0x7fb1a4092bf0 legacy=0x7fb1a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.413+0000 7fb1a8ede700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.51:6790/0 conn(0x7fb1a408fa70 legacy=0x7fb1a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975590934 0 0) 0x7fb1a4091010 con 0x7fb1a408fa70 2021-02-06T22:52:23.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb188003230 con 0x7fb1a408fa70 2021-02-06T22:52:23.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286757116 0 0) 0x7fb1a4095440 con 0x7fb1a4092bf0 2021-02-06T22:52:23.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a4091010 con 0x7fb1a4092bf0 2021-02-06T22:52:23.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a96df700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.106:6789/0 conn(0x7fb1a412ce00 legacy=0x7fb1a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1149120697 0 0) 0x7fb188003230 con 0x7fb1a408fa70 2021-02-06T22:52:23.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.106:6789/0 conn(0x7fb1a412ce00 legacy=0x7fb1a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.51:6789/0 conn(0x7fb1a4092bf0 legacy=0x7fb1a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40912b0 con 0x7fb1a408fa70 2021-02-06T22:52:23.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb198001930 con 0x7fb1a408fa70 2021-02-06T22:52:23.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb198001c40 con 0x7fb1a408fa70 2021-02-06T22:52:23.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1a37fe700 1 -- 172.21.15.51:0/4129735164 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb198004690 con 0x7fb1a408fa70 2021-02-06T22:52:23.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1ab142700 1 -- 172.21.15.51:0/4129735164 >> v1:172.21.15.51:6790/0 conn(0x7fb1a408fa70 legacy=0x7fb1a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1ab142700 1 -- 172.21.15.51:0/4129735164 shutdown_connections 2021-02-06T22:52:23.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.414+0000 7fb1ab142700 1 -- 172.21.15.51:0/4129735164 >> 172.21.15.51:0/4129735164 conn(0x7fb1a4096860 msgr2=0x7fb1a4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.415+0000 7fb1ab142700 1 -- 172.21.15.51:0/4129735164 shutdown_connections 2021-02-06T22:52:23.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.415+0000 7fb1ab142700 1 -- 172.21.15.51:0/4129735164 wait complete. 2021-02-06T22:52:23.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.415+0000 7fb1ab142700 1 librados: starting msgr at 2021-02-06T22:52:23.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.415+0000 7fb1ab142700 1 librados: starting objecter 2021-02-06T22:52:23.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.415+0000 7fb1ab142700 1 Processor -- start 2021-02-06T22:52:23.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 -- start start 2021-02-06T22:52:23.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 librados: setting wanted keys 2021-02-06T22:52:23.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 librados: calling monclient init 2021-02-06T22:52:23.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4127100 con 0x7fb1a408fa70 2021-02-06T22:52:23.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a412b550 con 0x7fb1a4092bf0 2021-02-06T22:52:23.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1ab142700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a4090bf0 con 0x7fb1a412ce00 2021-02-06T22:52:23.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1a8ede700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb1a408fa70 0x7fb1a412ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59330/0 (socket says 172.21.15.51:59330) 2021-02-06T22:52:23.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.416+0000 7fb1a8ede700 1 -- 172.21.15.51:0/1852676760 learned_addr learned my addr 172.21.15.51:0/1852676760 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a96df700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.51:6790/0 conn(0x7fb1a412ce00 legacy=0x7fb1a413d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a8ede700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.51:6789/0 conn(0x7fb1a408fa70 legacy=0x7fb1a412ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter ms_handle_connect 0x7fb1a412ce00 2021-02-06T22:52:23.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter ms_handle_connect 0x7fb1a408fa70 2021-02-06T22:52:23.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957423396 0 0) 0x7fb1a4127100 con 0x7fb1a408fa70 2021-02-06T22:52:23.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a3fff700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.106:6789/0 conn(0x7fb1a4092bf0 legacy=0x7fb1a4135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb184004bd0 con 0x7fb1a408fa70 2021-02-06T22:52:23.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter ms_handle_connect 0x7fb1a4092bf0 2021-02-06T22:52:23.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181488687 0 0) 0x7fb1a4090bf0 con 0x7fb1a412ce00 2021-02-06T22:52:23.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.418+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a4127100 con 0x7fb1a412ce00 2021-02-06T22:52:23.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005145280 0 0) 0x7fb1a412b550 con 0x7fb1a4092bf0 2021-02-06T22:52:23.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a4090bf0 con 0x7fb1a4092bf0 2021-02-06T22:52:23.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 914659993 0 0) 0x7fb184004bd0 con 0x7fb1a408fa70 2021-02-06T22:52:23.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1a412b550 con 0x7fb1a408fa70 2021-02-06T22:52:23.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb1980018f0 con 0x7fb1a408fa70 2021-02-06T22:52:23.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1320075921 0 0) 0x7fb1a4127100 con 0x7fb1a412ce00 2021-02-06T22:52:23.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb184004bd0 con 0x7fb1a412ce00 2021-02-06T22:52:23.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb19c001ee0 con 0x7fb1a412ce00 2021-02-06T22:52:23.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1057713127 0 0) 0x7fb1a412b550 con 0x7fb1a408fa70 2021-02-06T22:52:23.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.51:6790/0 conn(0x7fb1a412ce00 legacy=0x7fb1a413d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.106:6789/0 conn(0x7fb1a4092bf0 legacy=0x7fb1a4135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4129990 con 0x7fb1a408fa70 2021-02-06T22:52:23.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a4127820 con 0x7fb1a408fa70 2021-02-06T22:52:23.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1ab142700 10 client.4218.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:23.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a4135d40 con 0x7fb1a408fa70 2021-02-06T22:52:23.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1ab142700 1 librados: init done 2021-02-06T22:52:23.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb198001560 con 0x7fb1a408fa70 2021-02-06T22:52:23.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.419+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb198004ee0 con 0x7fb1a408fa70 2021-02-06T22:52:23.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fb198005040 con 0x7fb1a408fa70 2021-02-06T22:52:23.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c004d60 con 0x7fb1a408fa70 2021-02-06T22:52:23.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fb198039660 con 0x7fb1a408fa70 2021-02-06T22:52:23.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 10 client.4218.objecter ms_dispatch 0x7fb1a4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:23.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 3 client.4218.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:23.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 3 client.4218.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:23.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.420+0000 7fb1a0ff9700 20 client.4218.objecter dump_active .. 0 homeless 2021-02-06T22:52:23.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.422+0000 7fb1a0ff9700 10 client.4218.objecter ms_handle_connect 0x7fb1840304a0 2021-02-06T22:52:23.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.424+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fb198012380 con 0x7fb1a408fa70 2021-02-06T22:52:23.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.604+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17c005430 con 0x7fb1a408fa70 2021-02-06T22:52:23.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.605+0000 7fb1a0ff9700 1 -- 172.21.15.51:0/1852676760 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8441 (unknown 4221056075 0 3964562250) 0x7fb1980121a0 con 0x7fb1a408fa70 2021-02-06T22:52:23.605 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:23.605 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":15,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:23.220212+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-06T22:52:20.713249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:52:23.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.606+0000 7fb1ab142700 10 librados: watch_flush enter 2021-02-06T22:52:23.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.606+0000 7fb1ab142700 10 librados: watch_flush exit 2021-02-06T22:52:23.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.606+0000 7fb1ab142700 20 client.4218.objecter shutdown clearing up homeless session... 2021-02-06T22:52:23.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.606+0000 7fb1ab142700 10 client.4218.objecter successfully canceled tick 2021-02-06T22:52:23.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.106:6812/33219 conn(0x7fb1840304a0 legacy=0x7fb184032960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 >> v1:172.21.15.51:6789/0 conn(0x7fb1a408fa70 legacy=0x7fb1a412ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 shutdown_connections 2021-02-06T22:52:23.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 >> 172.21.15.51:0/1852676760 conn(0x7fb1a4096860 msgr2=0x7fb1a412bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 shutdown_connections 2021-02-06T22:52:23.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 -- 172.21.15.51:0/1852676760 wait complete. 2021-02-06T22:52:23.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.607+0000 7fb1ab142700 1 librados: shutdown 2021-02-06T22:52:23.617 INFO:tasks.ceph.ceph_manager.ceph:all up! 2021-02-06T22:52:23.618 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-06T22:52:23.741 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.741+0000 7f56d0d32700 1 Processor -- start 2021-02-06T22:52:23.741 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.741+0000 7f56d0d32700 1 -- start start 2021-02-06T22:52:23.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56d0d32700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc095050 con 0x7f56cc067ec0 2021-02-06T22:52:23.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56d0d32700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc128c00 con 0x7f56cc067a30 2021-02-06T22:52:23.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56d0d32700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc095280 con 0x7f56cc0999a0 2021-02-06T22:52:23.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56ca59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f56cc0999a0 0x7f56cc1284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59680/0 (socket says 172.21.15.51:59680) 2021-02-06T22:52:23.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56ca59c700 1 -- 172.21.15.51:0/3514455013 learned_addr learned my addr 172.21.15.51:0/3514455013 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.742+0000 7f56cad9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f56cc067ec0 0x7f56cc130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59342/0 (socket says 172.21.15.51:59342) 2021-02-06T22:52:23.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.744+0000 7f56ca59c700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.51:6790/0 conn(0x7f56cc0999a0 legacy=0x7f56cc1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.744+0000 7f56cad9d700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.51:6789/0 conn(0x7f56cc067ec0 legacy=0x7f56cc130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.744+0000 7f56c9d9b700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.106:6789/0 conn(0x7f56cc067a30 legacy=0x7f56cc12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3884498906 0 0) 0x7f56cc095050 con 0x7f56cc067ec0 2021-02-06T22:52:23.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b0003230 con 0x7f56cc067ec0 2021-02-06T22:52:23.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408872147 0 0) 0x7f56cc095280 con 0x7f56cc0999a0 2021-02-06T22:52:23.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc095050 con 0x7f56cc0999a0 2021-02-06T22:52:23.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3352279708 0 0) 0x7f56cc128c00 con 0x7f56cc067a30 2021-02-06T22:52:23.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc095280 con 0x7f56cc067a30 2021-02-06T22:52:23.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 885091211 0 0) 0x7f56cc095050 con 0x7f56cc0999a0 2021-02-06T22:52:23.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.106:6789/0 conn(0x7f56cc067a30 legacy=0x7f56cc12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.51:6789/0 conn(0x7f56cc067ec0 legacy=0x7f56cc130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc095520 con 0x7f56cc0999a0 2021-02-06T22:52:23.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56bc001950 con 0x7f56cc0999a0 2021-02-06T22:52:23.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f56bc001c60 con 0x7f56cc0999a0 2021-02-06T22:52:23.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56c959a700 1 -- 172.21.15.51:0/3514455013 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56bc004750 con 0x7f56cc0999a0 2021-02-06T22:52:23.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.745+0000 7f56d0d32700 1 -- 172.21.15.51:0/3514455013 >> v1:172.21.15.51:6790/0 conn(0x7f56cc0999a0 legacy=0x7f56cc1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 -- 172.21.15.51:0/3514455013 shutdown_connections 2021-02-06T22:52:23.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 -- 172.21.15.51:0/3514455013 >> 172.21.15.51:0/3514455013 conn(0x7f56cc096860 msgr2=0x7f56cc099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 -- 172.21.15.51:0/3514455013 shutdown_connections 2021-02-06T22:52:23.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 -- 172.21.15.51:0/3514455013 wait complete. 2021-02-06T22:52:23.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 librados: starting msgr at 2021-02-06T22:52:23.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 librados: starting objecter 2021-02-06T22:52:23.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 Processor -- start 2021-02-06T22:52:23.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 -- start start 2021-02-06T22:52:23.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 librados: setting wanted keys 2021-02-06T22:52:23.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.746+0000 7f56d0d32700 1 librados: calling monclient init 2021-02-06T22:52:23.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.747+0000 7f56d0d32700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc091c40 con 0x7f56cc067a30 2021-02-06T22:52:23.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.747+0000 7f56d0d32700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc131370 con 0x7f56cc0999a0 2021-02-06T22:52:23.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.747+0000 7f56d0d32700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc131610 con 0x7f56cc067ec0 2021-02-06T22:52:23.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.747+0000 7f56ca59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f56cc067a30 0x7f56cc1319d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59344/0 (socket says 172.21.15.51:59344) 2021-02-06T22:52:23.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.747+0000 7f56ca59c700 1 -- 172.21.15.51:0/3401598231 learned_addr learned my addr 172.21.15.51:0/3401598231 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:23.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ca59c700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.51:6789/0 conn(0x7f56cc067a30 legacy=0x7f56cc1319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter ms_handle_connect 0x7f56cc067a30 2021-02-06T22:52:23.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter ms_handle_connect 0x7f56cc067ec0 2021-02-06T22:52:23.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56c9d9b700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.51:6790/0 conn(0x7f56cc067ec0 legacy=0x7f56cc1369d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter ms_handle_connect 0x7f56cc0999a0 2021-02-06T22:52:23.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:23.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56cad9d700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.106:6789/0 conn(0x7f56cc0999a0 legacy=0x7f56cc141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:23.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46613801 0 0) 0x7f56cc091c40 con 0x7f56cc067a30 2021-02-06T22:52:23.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a8004bd0 con 0x7f56cc067a30 2021-02-06T22:52:23.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117631761 0 0) 0x7f56cc131610 con 0x7f56cc067ec0 2021-02-06T22:52:23.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc091c40 con 0x7f56cc067ec0 2021-02-06T22:52:23.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253206818 0 0) 0x7f56cc131370 con 0x7f56cc0999a0 2021-02-06T22:52:23.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.749+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc131610 con 0x7f56cc0999a0 2021-02-06T22:52:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2548970439 0 0) 0x7f56a8004bd0 con 0x7f56cc067a30 2021-02-06T22:52:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f56cc131370 con 0x7f56cc067a30 2021-02-06T22:52:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2921080674 0 0) 0x7f56cc091c40 con 0x7f56cc067ec0 2021-02-06T22:52:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f56a8004bd0 con 0x7f56cc067ec0 2021-02-06T22:52:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56bc001910 con 0x7f56cc067a30 2021-02-06T22:52:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56c0001c20 con 0x7f56cc067ec0 2021-02-06T22:52:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4252123375 0 0) 0x7f56cc131610 con 0x7f56cc0999a0 2021-02-06T22:52:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f56cc091c40 con 0x7f56cc0999a0 2021-02-06T22:52:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56c4001f10 con 0x7f56cc0999a0 2021-02-06T22:52:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3355873731 0 0) 0x7f56a8004bd0 con 0x7f56cc067ec0 2021-02-06T22:52:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.106:6789/0 conn(0x7f56cc0999a0 legacy=0x7f56cc141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.51:6789/0 conn(0x7f56cc067a30 legacy=0x7f56cc1319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc092410 con 0x7f56cc067ec0 2021-02-06T22:52:23.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc1320e0 con 0x7f56cc067ec0 2021-02-06T22:52:23.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56d0d32700 10 client.4211.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:23.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc1372a0 con 0x7f56cc067ec0 2021-02-06T22:52:23.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56d0d32700 1 librados: init done 2021-02-06T22:52:23.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f56c00021f0 con 0x7f56cc067ec0 2021-02-06T22:52:23.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.750+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f56c0002500 con 0x7f56cc067ec0 2021-02-06T22:52:23.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f56c00026e0 con 0x7f56cc067ec0 2021-02-06T22:52:23.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f56c0039370 con 0x7f56cc067ec0 2021-02-06T22:52:23.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac004d60 con 0x7f56cc067ec0 2021-02-06T22:52:23.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 10 client.4211.objecter ms_dispatch 0x7f56cc001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:23.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 3 client.4211.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:23.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 3 client.4211.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:23.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.751+0000 7f56ba7fc700 20 client.4211.objecter dump_active .. 0 homeless 2021-02-06T22:52:23.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.754+0000 7f56ba7fc700 10 client.4211.objecter ms_handle_connect 0x7f56a8030790 2021-02-06T22:52:23.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.755+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f56c0002c50 con 0x7f56cc067ec0 2021-02-06T22:52:23.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.934+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56ac005430 con 0x7f56cc067ec0 2021-02-06T22:52:23.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.935+0000 7f56ba7fc700 1 -- 172.21.15.51:0/3401598231 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8441 (unknown 4221056075 0 3964562250) 0x7f56c0011e50 con 0x7f56cc067ec0 2021-02-06T22:52:23.934 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:23.935 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":15,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:23.220212+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-06T22:52:20.713249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:52:23.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 10 librados: watch_flush enter 2021-02-06T22:52:23.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 10 librados: watch_flush exit 2021-02-06T22:52:23.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 20 client.4211.objecter shutdown clearing up homeless session... 2021-02-06T22:52:23.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 10 client.4211.objecter successfully canceled tick 2021-02-06T22:52:23.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.106:6812/33219 conn(0x7f56a8030790 legacy=0x7f56a8032c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 >> v1:172.21.15.51:6790/0 conn(0x7f56cc067ec0 legacy=0x7f56cc1369d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:23.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 shutdown_connections 2021-02-06T22:52:23.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 >> 172.21.15.51:0/3401598231 conn(0x7f56cc096860 msgr2=0x7f56cc097dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:23.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 shutdown_connections 2021-02-06T22:52:23.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 -- 172.21.15.51:0/3401598231 wait complete. 2021-02-06T22:52:23.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:23.936+0000 7f56d0d32700 1 librados: shutdown 2021-02-06T22:52:23.947 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2021-02-06T22:52:24.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.070+0000 7f31fa832700 1 Processor -- start 2021-02-06T22:52:24.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.070+0000 7f31fa832700 1 -- start start 2021-02-06T22:52:24.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31fa832700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f40915d0 con 0x7f31f40629e0 2021-02-06T22:52:24.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31fa832700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f4091ac0 con 0x7f31f40928d0 2021-02-06T22:52:24.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31fa832700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f4091d60 con 0x7f31f40999a0 2021-02-06T22:52:24.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31f3fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 0x7f31f40907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59696/0 (socket says 172.21.15.51:59696) 2021-02-06T22:52:24.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31f37fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f31f40629e0 0x7f31f4090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59352/0 (socket says 172.21.15.51:59352) 2021-02-06T22:52:24.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.071+0000 7f31f3fff700 1 -- 172.21.15.51:0/3956621078 learned_addr learned my addr 172.21.15.51:0/3956621078 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f3fff700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 legacy=0x7f31f40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f37fe700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.51:6789/0 conn(0x7f31f40629e0 legacy=0x7f31f4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954253327 0 0) 0x7f31f40915d0 con 0x7f31f40629e0 2021-02-06T22:52:24.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e0003230 con 0x7f31f40629e0 2021-02-06T22:52:24.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741807295 0 0) 0x7f31f4091d60 con 0x7f31f40999a0 2021-02-06T22:52:24.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.073+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f40915d0 con 0x7f31f40999a0 2021-02-06T22:52:24.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f8dcf700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.106:6789/0 conn(0x7f31f40928d0 legacy=0x7f31f412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3582427462 0 0) 0x7f31f40915d0 con 0x7f31f40999a0 2021-02-06T22:52:24.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.106:6789/0 conn(0x7f31f40928d0 legacy=0x7f31f412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.51:6789/0 conn(0x7f31f40629e0 legacy=0x7f31f4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4092000 con 0x7f31f40999a0 2021-02-06T22:52:24.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31e8001930 con 0x7f31f40999a0 2021-02-06T22:52:24.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f3fff700 1 --1- 172.21.15.51:0/3956621078 >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 0x7f31f40907b0 :-1 s=OPENED pgs=67 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f31e8004750 mon_map magic: 0 v1 2021-02-06T22:52:24.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31e8001c40 con 0x7f31f40999a0 2021-02-06T22:52:24.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31fa832700 1 -- 172.21.15.51:0/3956621078 >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 legacy=0x7f31f40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31f2ffd700 1 -- 172.21.15.51:0/3956621078 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31e8004750 con 0x7f31f40999a0 2021-02-06T22:52:24.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31fa832700 1 -- 172.21.15.51:0/3956621078 shutdown_connections 2021-02-06T22:52:24.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31fa832700 1 -- 172.21.15.51:0/3956621078 >> 172.21.15.51:0/3956621078 conn(0x7f31f4096860 msgr2=0x7f31f4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31fa832700 1 -- 172.21.15.51:0/3956621078 shutdown_connections 2021-02-06T22:52:24.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.074+0000 7f31fa832700 1 -- 172.21.15.51:0/3956621078 wait complete. 2021-02-06T22:52:24.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 librados: starting msgr at 2021-02-06T22:52:24.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 librados: starting objecter 2021-02-06T22:52:24.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 Processor -- start 2021-02-06T22:52:24.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 -- start start 2021-02-06T22:52:24.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 librados: setting wanted keys 2021-02-06T22:52:24.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.075+0000 7f31fa832700 1 librados: calling monclient init 2021-02-06T22:52:24.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31fa832700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f4063ce0 con 0x7f31f40928d0 2021-02-06T22:52:24.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31fa832700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f412fc10 con 0x7f31f40629e0 2021-02-06T22:52:24.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31fa832700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f412feb0 con 0x7f31f40999a0 2021-02-06T22:52:24.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31f8dcf700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 0x7f31f41425d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59704/0 (socket says 172.21.15.51:59704) 2021-02-06T22:52:24.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31f37fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f31f40928d0 0x7f31f40635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59360/0 (socket says 172.21.15.51:59360) 2021-02-06T22:52:24.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.076+0000 7f31f8dcf700 1 -- 172.21.15.51:0/2435656960 learned_addr learned my addr 172.21.15.51:0/2435656960 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31f37fe700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.51:6789/0 conn(0x7f31f40928d0 legacy=0x7f31f40635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter ms_handle_connect 0x7f31f40928d0 2021-02-06T22:52:24.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31f8dcf700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 legacy=0x7f31f41425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter ms_handle_connect 0x7f31f40999a0 2021-02-06T22:52:24.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter ms_handle_connect 0x7f31f40629e0 2021-02-06T22:52:24.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31f3fff700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.106:6789/0 conn(0x7f31f40629e0 legacy=0x7f31f4062ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743950119 0 0) 0x7f31f4063ce0 con 0x7f31f40928d0 2021-02-06T22:52:24.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d4004bd0 con 0x7f31f40928d0 2021-02-06T22:52:24.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581618126 0 0) 0x7f31f412feb0 con 0x7f31f40999a0 2021-02-06T22:52:24.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f4063ce0 con 0x7f31f40999a0 2021-02-06T22:52:24.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255217080 0 0) 0x7f31f412fc10 con 0x7f31f40629e0 2021-02-06T22:52:24.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.078+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f412feb0 con 0x7f31f40629e0 2021-02-06T22:52:24.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2505971622 0 0) 0x7f31d4004bd0 con 0x7f31f40928d0 2021-02-06T22:52:24.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31f412fc10 con 0x7f31f40928d0 2021-02-06T22:52:24.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3274949303 0 0) 0x7f31f4063ce0 con 0x7f31f40999a0 2021-02-06T22:52:24.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31d4004bd0 con 0x7f31f40999a0 2021-02-06T22:52:24.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2635332081 0 0) 0x7f31f412feb0 con 0x7f31f40629e0 2021-02-06T22:52:24.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31f4063ce0 con 0x7f31f40629e0 2021-02-06T22:52:24.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31e4001c60 con 0x7f31f40928d0 2021-02-06T22:52:24.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31ec001f60 con 0x7f31f40999a0 2021-02-06T22:52:24.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31e80018f0 con 0x7f31f40629e0 2021-02-06T22:52:24.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2632927846 0 0) 0x7f31f412fc10 con 0x7f31f40928d0 2021-02-06T22:52:24.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.51:6790/0 conn(0x7f31f40999a0 legacy=0x7f31f41425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.106:6789/0 conn(0x7f31f40629e0 legacy=0x7f31f4062ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4095160 con 0x7f31f40928d0 2021-02-06T22:52:24.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f4130270 con 0x7f31f40928d0 2021-02-06T22:52:24.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31fa832700 10 client.4230.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4128480 con 0x7f31f40928d0 2021-02-06T22:52:24.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31fa832700 1 librados: init done 2021-02-06T22:52:24.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31e4004870 con 0x7f31f40928d0 2021-02-06T22:52:24.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.079+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f31e4004b80 con 0x7f31f40928d0 2021-02-06T22:52:24.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f31e4004da0 con 0x7f31f40928d0 2021-02-06T22:52:24.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31fa832700 10 client.4230.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31fa832700 15 client.4230.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31fa832700 20 client.4230.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31fa832700 10 client.4230.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31cc002870 con 0x7f31f40928d0 2021-02-06T22:52:24.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f31e4039490 con 0x7f31f40928d0 2021-02-06T22:52:24.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 10 client.4230.objecter ms_dispatch 0x7f31f4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 3 client.4230.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 3 client.4230.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 10 client.4230.objecter checking command 1 2021-02-06T22:52:24.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter _get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 15 client.4230.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter _get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 15 client.4230.objecter _session_command_op_assign 0 1 2021-02-06T22:52:24.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 4 2021-02-06T22:52:24.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 10 client.4230.objecter _send_command 1 2021-02-06T22:52:24.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6804/33691 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31d403af30 con 0x7f31d40372a0 2021-02-06T22:52:24.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 20 client.4230.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.080+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f31e4005dd0 con 0x7f31f40928d0 2021-02-06T22:52:24.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.082+0000 7f31dbfff700 10 client.4230.objecter ms_handle_connect 0x7f31d40307c0 2021-02-06T22:52:24.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 10 client.4230.objecter ms_handle_connect 0x7f31d40372a0 2021-02-06T22:52:24.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== osd.0 v1:172.21.15.51:6804/33691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f31d403af30 con 0x7f31d40372a0 2021-02-06T22:52:24.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 10 client.4230.objecter ms_dispatch 0x7f31f4001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 10 client.4230.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 4 2021-02-06T22:52:24.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.085+0000 7f31dbfff700 15 client.4230.objecter _session_command_op_remove 0 1 2021-02-06T22:52:24.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 10 client.4230.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 15 client.4230.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 20 client.4230.objecter _get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 20 client.4230.objecter _get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 15 client.4230.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 20 client.4230.objecter get_session s=0x7f31d4036bf0 osd=0 3 2021-02-06T22:52:24.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 15 client.4230.objecter _session_command_op_assign 0 2 2021-02-06T22:52:24.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 4 2021-02-06T22:52:24.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 10 client.4230.objecter _send_command 2 2021-02-06T22:52:24.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 --> v1:172.21.15.51:6804/33691 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31cc001100 con 0x7f31d40372a0 2021-02-06T22:52:24.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31dbfff700 1 -- 172.21.15.51:0/2435656960 <== osd.0 v1:172.21.15.51:6804/33691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2570787547) 0x7f31cc001100 con 0x7f31d40372a0 2021-02-06T22:52:24.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31dbfff700 10 client.4230.objecter ms_dispatch 0x7f31f4001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31dbfff700 10 client.4230.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31dbfff700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 4 2021-02-06T22:52:24.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.102+0000 7f31dbfff700 15 client.4230.objecter _session_command_op_remove 0 2 2021-02-06T22:52:24.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 10 librados: watch_flush enter 2021-02-06T22:52:24.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 10 librados: watch_flush exit 2021-02-06T22:52:24.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 10 client.4230.objecter close_session for osd.0 2021-02-06T22:52:24.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.51:6804/33691 conn(0x7f31d40372a0 legacy=0x7f31d40396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 20 client.4230.objecter put_session s=0x7f31d4036bf0 osd=0 1 2021-02-06T22:52:24.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 20 client.4230.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 10 client.4230.objecter successfully canceled tick 2021-02-06T22:52:24.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.106:6812/33219 conn(0x7f31d40307c0 legacy=0x7f31d4032c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 >> v1:172.21.15.51:6789/0 conn(0x7f31f40928d0 legacy=0x7f31f40635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31f8dcf700 1 -- 172.21.15.51:0/2435656960 reap_dead start 2021-02-06T22:52:24.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 shutdown_connections 2021-02-06T22:52:24.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 >> 172.21.15.51:0/2435656960 conn(0x7f31f4096860 msgr2=0x7f31f4098970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 shutdown_connections 2021-02-06T22:52:24.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 -- 172.21.15.51:0/2435656960 wait complete. 2021-02-06T22:52:24.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.103+0000 7f31fa832700 1 librados: shutdown 2021-02-06T22:52:24.113 INFO:teuthology.orchestra.run.smithi051.stdout:47244640258 2021-02-06T22:52:24.113 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2021-02-06T22:52:24.237 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.237+0000 7fba3aa77700 1 Processor -- start 2021-02-06T22:52:24.237 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.237+0000 7fba3aa77700 1 -- start start 2021-02-06T22:52:24.238 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba3aa77700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34095050 con 0x7fba340999a0 2021-02-06T22:52:24.238 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba3aa77700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34128c00 con 0x7fba34067ec0 2021-02-06T22:52:24.238 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba3aa77700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34095280 con 0x7fba34067a30 2021-02-06T22:52:24.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba33fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 0x7fba3412d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59710/0 (socket says 172.21.15.51:59710) 2021-02-06T22:52:24.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba33fff700 1 -- 172.21.15.51:0/2493598361 learned_addr learned my addr 172.21.15.51:0/2493598361 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.238+0000 7fba38813700 1 --1- 172.21.15.51:0/2493598361 >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 0x7fba341284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59368/0 (socket says 172.21.15.51:59368) 2021-02-06T22:52:24.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.240+0000 7fba33fff700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 legacy=0x7fba3412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.240+0000 7fba38813700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 legacy=0x7fba341284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.240+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028605563 0 0) 0x7fba34095280 con 0x7fba34067a30 2021-02-06T22:52:24.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.240+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18003230 con 0x7fba34067a30 2021-02-06T22:52:24.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.240+0000 7fba39014700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.106:6789/0 conn(0x7fba34067ec0 legacy=0x7fba34130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744544443 0 0) 0x7fba34095050 con 0x7fba340999a0 2021-02-06T22:52:24.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34095280 con 0x7fba340999a0 2021-02-06T22:52:24.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648579774 0 0) 0x7fba34128c00 con 0x7fba34067ec0 2021-02-06T22:52:24.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34095050 con 0x7fba34067ec0 2021-02-06T22:52:24.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4283525179 0 0) 0x7fba18003230 con 0x7fba34067a30 2021-02-06T22:52:24.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.106:6789/0 conn(0x7fba34067ec0 legacy=0x7fba34130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 legacy=0x7fba341284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34095520 con 0x7fba34067a30 2021-02-06T22:52:24.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba20001970 con 0x7fba34067a30 2021-02-06T22:52:24.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fba20001c80 con 0x7fba34067a30 2021-02-06T22:52:24.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba337fe700 1 -- 172.21.15.51:0/2493598361 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba20004750 con 0x7fba34067a30 2021-02-06T22:52:24.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba3aa77700 1 -- 172.21.15.51:0/2493598361 >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 legacy=0x7fba3412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba3aa77700 1 -- 172.21.15.51:0/2493598361 shutdown_connections 2021-02-06T22:52:24.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba3aa77700 1 -- 172.21.15.51:0/2493598361 >> 172.21.15.51:0/2493598361 conn(0x7fba34096860 msgr2=0x7fba34099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba3aa77700 1 -- 172.21.15.51:0/2493598361 shutdown_connections 2021-02-06T22:52:24.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.241+0000 7fba3aa77700 1 -- 172.21.15.51:0/2493598361 wait complete. 2021-02-06T22:52:24.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 librados: starting msgr at 2021-02-06T22:52:24.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 librados: starting objecter 2021-02-06T22:52:24.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 Processor -- start 2021-02-06T22:52:24.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 -- start start 2021-02-06T22:52:24.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 librados: setting wanted keys 2021-02-06T22:52:24.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.242+0000 7fba3aa77700 1 librados: calling monclient init 2021-02-06T22:52:24.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba3aa77700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba34093230 con 0x7fba340999a0 2021-02-06T22:52:24.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba3aa77700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3412d900 con 0x7fba34067ec0 2021-02-06T22:52:24.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba3aa77700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3412b5e0 con 0x7fba34067a30 2021-02-06T22:52:24.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba39014700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 0x7fba34140600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59378/0 (socket says 172.21.15.51:59378) 2021-02-06T22:52:24.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba38813700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 0x7fba3412a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59716/0 (socket says 172.21.15.51:59716) 2021-02-06T22:52:24.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.243+0000 7fba39014700 1 -- 172.21.15.51:0/3552650808 learned_addr learned my addr 172.21.15.51:0/3552650808 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba39014700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 legacy=0x7fba34140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba38813700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 legacy=0x7fba3412a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter ms_handle_connect 0x7fba340999a0 2021-02-06T22:52:24.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter ms_handle_connect 0x7fba34067a30 2021-02-06T22:52:24.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter ms_handle_connect 0x7fba34067ec0 2021-02-06T22:52:24.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba33fff700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.106:6789/0 conn(0x7fba34067ec0 legacy=0x7fba3412aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678175047 0 0) 0x7fba34093230 con 0x7fba340999a0 2021-02-06T22:52:24.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba14004bd0 con 0x7fba340999a0 2021-02-06T22:52:24.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685567526 0 0) 0x7fba3412b5e0 con 0x7fba34067a30 2021-02-06T22:52:24.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34093230 con 0x7fba34067a30 2021-02-06T22:52:24.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017342022 0 0) 0x7fba3412d900 con 0x7fba34067ec0 2021-02-06T22:52:24.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3412b5e0 con 0x7fba34067ec0 2021-02-06T22:52:24.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1565731849 0 0) 0x7fba14004bd0 con 0x7fba340999a0 2021-02-06T22:52:24.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba3412d900 con 0x7fba340999a0 2021-02-06T22:52:24.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.245+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba2c001fe0 con 0x7fba340999a0 2021-02-06T22:52:24.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 407418142 0 0) 0x7fba34093230 con 0x7fba34067a30 2021-02-06T22:52:24.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba14004bd0 con 0x7fba34067a30 2021-02-06T22:52:24.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba28001bb0 con 0x7fba34067a30 2021-02-06T22:52:24.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4017161659 0 0) 0x7fba3412b5e0 con 0x7fba34067ec0 2021-02-06T22:52:24.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba34093230 con 0x7fba34067ec0 2021-02-06T22:52:24.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba20001930 con 0x7fba34067ec0 2021-02-06T22:52:24.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1327825703 0 0) 0x7fba3412d900 con 0x7fba340999a0 2021-02-06T22:52:24.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.51:6790/0 conn(0x7fba34067a30 legacy=0x7fba3412a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.106:6789/0 conn(0x7fba34067ec0 legacy=0x7fba3412aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3412e1f0 con 0x7fba340999a0 2021-02-06T22:52:24.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba341321f0 con 0x7fba340999a0 2021-02-06T22:52:24.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 10 client.4236.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fba34125770 con 0x7fba340999a0 2021-02-06T22:52:24.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 1 librados: init done 2021-02-06T22:52:24.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fba2c002610 con 0x7fba340999a0 2021-02-06T22:52:24.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fba2c002920 con 0x7fba340999a0 2021-02-06T22:52:24.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fba2c002b40 con 0x7fba340999a0 2021-02-06T22:52:24.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 10 client.4236.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 15 client.4236.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 20 client.4236.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 10 client.4236.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.246+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba0c002870 con 0x7fba340999a0 2021-02-06T22:52:24.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fba2c0397c0 con 0x7fba340999a0 2021-02-06T22:52:24.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 10 client.4236.objecter ms_dispatch 0x7fba34001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 3 client.4236.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 3 client.4236.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 10 client.4236.objecter checking command 1 2021-02-06T22:52:24.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter _get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 15 client.4236.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter _get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 15 client.4236.objecter _session_command_op_assign 1 1 2021-02-06T22:52:24.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 4 2021-02-06T22:52:24.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 10 client.4236.objecter _send_command 1 2021-02-06T22:52:24.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6800/33692 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba1403af30 con 0x7fba140372a0 2021-02-06T22:52:24.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 20 client.4236.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.247+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fba2c012420 con 0x7fba340999a0 2021-02-06T22:52:24.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.249+0000 7fba30ff9700 10 client.4236.objecter ms_handle_connect 0x7fba140307c0 2021-02-06T22:52:24.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.251+0000 7fba30ff9700 10 client.4236.objecter ms_handle_connect 0x7fba140372a0 2021-02-06T22:52:24.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.252+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== osd.1 v1:172.21.15.51:6800/33692 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7fba1403af30 con 0x7fba140372a0 2021-02-06T22:52:24.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.252+0000 7fba30ff9700 10 client.4236.objecter ms_dispatch 0x7fba34001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.252+0000 7fba30ff9700 10 client.4236.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.252+0000 7fba30ff9700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 4 2021-02-06T22:52:24.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.252+0000 7fba30ff9700 15 client.4236.objecter _session_command_op_remove 1 1 2021-02-06T22:52:24.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 10 client.4236.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 15 client.4236.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 20 client.4236.objecter _get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 20 client.4236.objecter _get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 15 client.4236.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 20 client.4236.objecter get_session s=0x7fba14036bf0 osd=1 3 2021-02-06T22:52:24.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 15 client.4236.objecter _session_command_op_assign 1 2 2021-02-06T22:52:24.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 4 2021-02-06T22:52:24.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 10 client.4236.objecter _send_command 2 2021-02-06T22:52:24.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 --> v1:172.21.15.51:6800/33692 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba0c001100 con 0x7fba140372a0 2021-02-06T22:52:24.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba30ff9700 1 -- 172.21.15.51:0/3552650808 <== osd.1 v1:172.21.15.51:6800/33692 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7fba0c001100 con 0x7fba140372a0 2021-02-06T22:52:24.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba30ff9700 10 client.4236.objecter ms_dispatch 0x7fba34001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba30ff9700 10 client.4236.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba30ff9700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 4 2021-02-06T22:52:24.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.269+0000 7fba30ff9700 15 client.4236.objecter _session_command_op_remove 1 2 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 10 librados: watch_flush enter 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 10 librados: watch_flush exit 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 10 client.4236.objecter close_session for osd.1 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.51:6800/33692 conn(0x7fba140372a0 legacy=0x7fba140396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 20 client.4236.objecter put_session s=0x7fba14036bf0 osd=1 1 2021-02-06T22:52:24.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 20 client.4236.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 10 client.4236.objecter successfully canceled tick 2021-02-06T22:52:24.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.106:6812/33219 conn(0x7fba140307c0 legacy=0x7fba14032c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 >> v1:172.21.15.51:6789/0 conn(0x7fba340999a0 legacy=0x7fba34140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba39014700 1 -- 172.21.15.51:0/3552650808 reap_dead start 2021-02-06T22:52:24.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 shutdown_connections 2021-02-06T22:52:24.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 >> 172.21.15.51:0/3552650808 conn(0x7fba34096860 msgr2=0x7fba34126120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 shutdown_connections 2021-02-06T22:52:24.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 -- 172.21.15.51:0/3552650808 wait complete. 2021-02-06T22:52:24.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.270+0000 7fba3aa77700 1 librados: shutdown 2021-02-06T22:52:24.280 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:24.281 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2021-02-06T22:52:24.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.404+0000 7ff9447dc700 1 Processor -- start 2021-02-06T22:52:24.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.404+0000 7ff9447dc700 1 -- start start 2021-02-06T22:52:24.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff9447dc700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c095440 con 0x7ff93c08fa70 2021-02-06T22:52:24.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff9447dc700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c0907b0 con 0x7ff93c092bf0 2021-02-06T22:52:24.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff9447dc700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c091010 con 0x7ff93c12ce00 2021-02-06T22:52:24.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff942578700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff93c08fa70 0x7ff93c0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59384/0 (socket says 172.21.15.51:59384) 2021-02-06T22:52:24.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff942d79700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff93c12ce00 0x7ff93c12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59728/0 (socket says 172.21.15.51:59728) 2021-02-06T22:52:24.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.405+0000 7ff942578700 1 -- 172.21.15.51:0/1199907373 learned_addr learned my addr 172.21.15.51:0/1199907373 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff942d79700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.51:6790/0 conn(0x7ff93c12ce00 legacy=0x7ff93c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff942578700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.51:6789/0 conn(0x7ff93c08fa70 legacy=0x7ff93c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134345547 0 0) 0x7ff93c095440 con 0x7ff93c08fa70 2021-02-06T22:52:24.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff924003230 con 0x7ff93c08fa70 2021-02-06T22:52:24.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880427449 0 0) 0x7ff93c091010 con 0x7ff93c12ce00 2021-02-06T22:52:24.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c095440 con 0x7ff93c12ce00 2021-02-06T22:52:24.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941d77700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.106:6789/0 conn(0x7ff93c092bf0 legacy=0x7ff93c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 328536128 0 0) 0x7ff924003230 con 0x7ff93c08fa70 2021-02-06T22:52:24.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.51:6790/0 conn(0x7ff93c12ce00 legacy=0x7ff93c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.106:6789/0 conn(0x7ff93c092bf0 legacy=0x7ff93c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0912b0 con 0x7ff93c08fa70 2021-02-06T22:52:24.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.407+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff92c001860 con 0x7ff93c08fa70 2021-02-06T22:52:24.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff92c001b70 con 0x7ff93c08fa70 2021-02-06T22:52:24.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff941576700 1 -- 172.21.15.51:0/1199907373 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff92c0045b0 con 0x7ff93c08fa70 2021-02-06T22:52:24.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff9447dc700 1 -- 172.21.15.51:0/1199907373 >> v1:172.21.15.51:6789/0 conn(0x7ff93c08fa70 legacy=0x7ff93c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff9447dc700 1 -- 172.21.15.51:0/1199907373 shutdown_connections 2021-02-06T22:52:24.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff9447dc700 1 -- 172.21.15.51:0/1199907373 >> 172.21.15.51:0/1199907373 conn(0x7ff93c096860 msgr2=0x7ff93c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff9447dc700 1 -- 172.21.15.51:0/1199907373 shutdown_connections 2021-02-06T22:52:24.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.408+0000 7ff9447dc700 1 -- 172.21.15.51:0/1199907373 wait complete. 2021-02-06T22:52:24.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 librados: starting msgr at 2021-02-06T22:52:24.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 librados: starting objecter 2021-02-06T22:52:24.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 Processor -- start 2021-02-06T22:52:24.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 -- start start 2021-02-06T22:52:24.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 librados: setting wanted keys 2021-02-06T22:52:24.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 librados: calling monclient init 2021-02-06T22:52:24.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c097a80 con 0x7ff93c092bf0 2021-02-06T22:52:24.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c114230 con 0x7ff93c12ce00 2021-02-06T22:52:24.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff9447dc700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff93c1144d0 con 0x7ff93c08fa70 2021-02-06T22:52:24.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff942578700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff93c08fa70 0x7ff93c139fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59730/0 (socket says 172.21.15.51:59730) 2021-02-06T22:52:24.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.409+0000 7ff942578700 1 -- 172.21.15.51:0/2962266900 learned_addr learned my addr 172.21.15.51:0/2962266900 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff942578700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.51:6790/0 conn(0x7ff93c08fa70 legacy=0x7ff93c139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter ms_handle_connect 0x7ff93c08fa70 2021-02-06T22:52:24.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff941d77700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.51:6789/0 conn(0x7ff93c092bf0 legacy=0x7ff93c13ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter ms_handle_connect 0x7ff93c092bf0 2021-02-06T22:52:24.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter ms_handle_connect 0x7ff93c12ce00 2021-02-06T22:52:24.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff942d79700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.106:6789/0 conn(0x7ff93c12ce00 legacy=0x7ff93c142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071078012 0 0) 0x7ff93c1144d0 con 0x7ff93c08fa70 2021-02-06T22:52:24.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff91c004bd0 con 0x7ff93c08fa70 2021-02-06T22:52:24.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105747018 0 0) 0x7ff93c097a80 con 0x7ff93c092bf0 2021-02-06T22:52:24.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c1144d0 con 0x7ff93c092bf0 2021-02-06T22:52:24.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451352294 0 0) 0x7ff93c114230 con 0x7ff93c12ce00 2021-02-06T22:52:24.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c097a80 con 0x7ff93c12ce00 2021-02-06T22:52:24.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4208414687 0 0) 0x7ff91c004bd0 con 0x7ff93c08fa70 2021-02-06T22:52:24.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff93c114230 con 0x7ff93c08fa70 2021-02-06T22:52:24.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff92c0044f0 con 0x7ff93c08fa70 2021-02-06T22:52:24.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2802947475 0 0) 0x7ff93c1144d0 con 0x7ff93c092bf0 2021-02-06T22:52:24.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff91c004bd0 con 0x7ff93c092bf0 2021-02-06T22:52:24.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff938001b60 con 0x7ff93c092bf0 2021-02-06T22:52:24.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2189355207 0 0) 0x7ff93c097a80 con 0x7ff93c12ce00 2021-02-06T22:52:24.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff93c1144d0 con 0x7ff93c12ce00 2021-02-06T22:52:24.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff934001fb0 con 0x7ff93c12ce00 2021-02-06T22:52:24.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2345671003 0 0) 0x7ff93c114230 con 0x7ff93c08fa70 2021-02-06T22:52:24.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.106:6789/0 conn(0x7ff93c12ce00 legacy=0x7ff93c142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.51:6789/0 conn(0x7ff93c092bf0 legacy=0x7ff93c13ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c1317c0 con 0x7ff93c08fa70 2021-02-06T22:52:24.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c13a6d0 con 0x7ff93c08fa70 2021-02-06T22:52:24.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff9447dc700 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff93c132620 con 0x7ff93c08fa70 2021-02-06T22:52:24.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff9447dc700 1 librados: init done 2021-02-06T22:52:24.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff92c004d30 con 0x7ff93c08fa70 2021-02-06T22:52:24.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.412+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff92c005040 con 0x7ff93c08fa70 2021-02-06T22:52:24.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ff92c00d800 con 0x7ff93c08fa70 2021-02-06T22:52:24.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff9447dc700 10 client.4229.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff9447dc700 15 client.4229.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff9447dc700 20 client.4229.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff9447dc700 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff920002870 con 0x7ff93c08fa70 2021-02-06T22:52:24.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ff92c039540 con 0x7ff93c08fa70 2021-02-06T22:52:24.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 10 client.4229.objecter ms_dispatch 0x7ff93c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 3 client.4229.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 3 client.4229.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 10 client.4229.objecter checking command 1 2021-02-06T22:52:24.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter _get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 15 client.4229.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter _get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 15 client.4229.objecter _session_command_op_assign 2 1 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 4 2021-02-06T22:52:24.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 10 client.4229.objecter _send_command 1 2021-02-06T22:52:24.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6808/33693 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff91c03af70 con 0x7ff91c0372e0 2021-02-06T22:52:24.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 20 client.4229.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.413+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7ff92c001510 con 0x7ff93c08fa70 2021-02-06T22:52:24.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.416+0000 7ff92a7fc700 10 client.4229.objecter ms_handle_connect 0x7ff91c030820 2021-02-06T22:52:24.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.418+0000 7ff92a7fc700 10 client.4229.objecter ms_handle_connect 0x7ff91c0372e0 2021-02-06T22:52:24.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.419+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== osd.2 v1:172.21.15.51:6808/33693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7ff91c03af70 con 0x7ff91c0372e0 2021-02-06T22:52:24.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.419+0000 7ff92a7fc700 10 client.4229.objecter ms_dispatch 0x7ff93c001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.419+0000 7ff92a7fc700 10 client.4229.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.419+0000 7ff92a7fc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 4 2021-02-06T22:52:24.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.419+0000 7ff92a7fc700 15 client.4229.objecter _session_command_op_remove 2 1 2021-02-06T22:52:24.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 10 client.4229.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 15 client.4229.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 20 client.4229.objecter _get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 20 client.4229.objecter _get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 15 client.4229.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 20 client.4229.objecter get_session s=0x7ff91c036c30 osd=2 3 2021-02-06T22:52:24.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 15 client.4229.objecter _session_command_op_assign 2 2 2021-02-06T22:52:24.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 4 2021-02-06T22:52:24.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 10 client.4229.objecter _send_command 2 2021-02-06T22:52:24.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 --> v1:172.21.15.51:6808/33693 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff920001100 con 0x7ff91c0372e0 2021-02-06T22:52:24.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff92a7fc700 1 -- 172.21.15.51:0/2962266900 <== osd.2 v1:172.21.15.51:6808/33693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 654699149) 0x7ff920001100 con 0x7ff91c0372e0 2021-02-06T22:52:24.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff92a7fc700 10 client.4229.objecter ms_dispatch 0x7ff93c001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff92a7fc700 10 client.4229.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff92a7fc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 4 2021-02-06T22:52:24.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.435+0000 7ff92a7fc700 15 client.4229.objecter _session_command_op_remove 2 2 2021-02-06T22:52:24.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 10 librados: watch_flush enter 2021-02-06T22:52:24.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 10 librados: watch_flush exit 2021-02-06T22:52:24.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 10 client.4229.objecter close_session for osd.2 2021-02-06T22:52:24.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.51:6808/33693 conn(0x7ff91c0372e0 legacy=0x7ff91c039700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 20 client.4229.objecter put_session s=0x7ff91c036c30 osd=2 1 2021-02-06T22:52:24.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 20 client.4229.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 10 client.4229.objecter successfully canceled tick 2021-02-06T22:52:24.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.106:6812/33219 conn(0x7ff91c030820 legacy=0x7ff91c032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 >> v1:172.21.15.51:6790/0 conn(0x7ff93c08fa70 legacy=0x7ff93c139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff942d79700 1 -- 172.21.15.51:0/2962266900 reap_dead start 2021-02-06T22:52:24.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 shutdown_connections 2021-02-06T22:52:24.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 >> 172.21.15.51:0/2962266900 conn(0x7ff93c096860 msgr2=0x7ff93c093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 shutdown_connections 2021-02-06T22:52:24.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 -- 172.21.15.51:0/2962266900 wait complete. 2021-02-06T22:52:24.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.436+0000 7ff9447dc700 1 librados: shutdown 2021-02-06T22:52:24.446 INFO:teuthology.orchestra.run.smithi051.stdout:47244640260 2021-02-06T22:52:24.446 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2021-02-06T22:52:24.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.570+0000 7f3af1b9f700 1 Processor -- start 2021-02-06T22:52:24.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.570+0000 7f3af1b9f700 1 -- start start 2021-02-06T22:52:24.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3af1b9f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec090db0 con 0x7f3aec093ec0 2021-02-06T22:52:24.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3af1b9f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec091050 con 0x7f3aec12cd30 2021-02-06T22:52:24.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3af1b9f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec0912f0 con 0x7f3aec093ae0 2021-02-06T22:52:24.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3af0b9d700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3aec093ae0 0x7f3aec091d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59740/0 (socket says 172.21.15.51:59740) 2021-02-06T22:52:24.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3aebfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ec0 0x7f3aec094370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59398/0 (socket says 172.21.15.51:59398) 2021-02-06T22:52:24.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.571+0000 7f3af0b9d700 1 -- 172.21.15.51:0/1895068262 learned_addr learned my addr 172.21.15.51:0/1895068262 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aebfff700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ec0 legacy=0x7f3aec094370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3af0b9d700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.51:6790/0 conn(0x7f3aec093ae0 legacy=0x7f3aec091d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818895742 0 0) 0x7f3aec090db0 con 0x7f3aec093ec0 2021-02-06T22:52:24.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3af139e700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.106:6789/0 conn(0x7f3aec12cd30 legacy=0x7f3aec12f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad0003230 con 0x7f3aec093ec0 2021-02-06T22:52:24.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621465682 0 0) 0x7f3aec0912f0 con 0x7f3aec093ae0 2021-02-06T22:52:24.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec090db0 con 0x7f3aec093ae0 2021-02-06T22:52:24.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031061060 0 0) 0x7f3aec091050 con 0x7f3aec12cd30 2021-02-06T22:52:24.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec0912f0 con 0x7f3aec12cd30 2021-02-06T22:52:24.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1635551656 0 0) 0x7f3ad0003230 con 0x7f3aec093ec0 2021-02-06T22:52:24.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.51:6790/0 conn(0x7f3aec093ae0 legacy=0x7f3aec091d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.106:6789/0 conn(0x7f3aec12cd30 legacy=0x7f3aec12f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec091590 con 0x7f3aec093ec0 2021-02-06T22:52:24.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.573+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3ad8001930 con 0x7f3aec093ec0 2021-02-06T22:52:24.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3ad8001c40 con 0x7f3aec093ec0 2021-02-06T22:52:24.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3aeb7fe700 1 -- 172.21.15.51:0/1895068262 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3ad8004690 con 0x7f3aec093ec0 2021-02-06T22:52:24.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3af1b9f700 1 -- 172.21.15.51:0/1895068262 >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ec0 legacy=0x7f3aec094370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3af1b9f700 1 -- 172.21.15.51:0/1895068262 shutdown_connections 2021-02-06T22:52:24.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3af1b9f700 1 -- 172.21.15.51:0/1895068262 >> 172.21.15.51:0/1895068262 conn(0x7f3aec0990c0 msgr2=0x7f3aec0994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3af1b9f700 1 -- 172.21.15.51:0/1895068262 shutdown_connections 2021-02-06T22:52:24.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.574+0000 7f3af1b9f700 1 -- 172.21.15.51:0/1895068262 wait complete. 2021-02-06T22:52:24.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 librados: starting msgr at 2021-02-06T22:52:24.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 librados: starting objecter 2021-02-06T22:52:24.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 Processor -- start 2021-02-06T22:52:24.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 -- start start 2021-02-06T22:52:24.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 librados: setting wanted keys 2021-02-06T22:52:24.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.575+0000 7f3af1b9f700 1 librados: calling monclient init 2021-02-06T22:52:24.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.576+0000 7f3af1b9f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec13a930 con 0x7f3aec093ae0 2021-02-06T22:52:24.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.576+0000 7f3af1b9f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec126330 con 0x7f3aec093ec0 2021-02-06T22:52:24.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.576+0000 7f3af1b9f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec1265a0 con 0x7f3aec12cd30 2021-02-06T22:52:24.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.576+0000 7f3af0b9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ae0 0x7f3aec139a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59404/0 (socket says 172.21.15.51:59404) 2021-02-06T22:52:24.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.576+0000 7f3af0b9d700 1 -- 172.21.15.51:0/764529555 learned_addr learned my addr 172.21.15.51:0/764529555 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3af139e700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.51:6790/0 conn(0x7f3aec12cd30 legacy=0x7f3aec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3af0b9d700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ae0 legacy=0x7f3aec139a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter ms_handle_connect 0x7f3aec12cd30 2021-02-06T22:52:24.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter ms_handle_connect 0x7f3aec093ae0 2021-02-06T22:52:24.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839823006 0 0) 0x7f3aec1265a0 con 0x7f3aec12cd30 2021-02-06T22:52:24.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3acc004bd0 con 0x7f3aec12cd30 2021-02-06T22:52:24.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801147630 0 0) 0x7f3aec13a930 con 0x7f3aec093ae0 2021-02-06T22:52:24.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec1265a0 con 0x7f3aec093ae0 2021-02-06T22:52:24.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter ms_handle_connect 0x7f3aec093ec0 2021-02-06T22:52:24.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3aebfff700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.106:6789/0 conn(0x7f3aec093ec0 legacy=0x7f3aec12bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2642194933 0 0) 0x7f3acc004bd0 con 0x7f3aec12cd30 2021-02-06T22:52:24.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3aec13a930 con 0x7f3aec12cd30 2021-02-06T22:52:24.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3ae4001f60 con 0x7f3aec12cd30 2021-02-06T22:52:24.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 646348204 0 0) 0x7f3aec1265a0 con 0x7f3aec093ae0 2021-02-06T22:52:24.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3acc004bd0 con 0x7f3aec093ae0 2021-02-06T22:52:24.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315775440 0 0) 0x7f3aec126330 con 0x7f3aec093ec0 2021-02-06T22:52:24.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec1265a0 con 0x7f3aec093ec0 2021-02-06T22:52:24.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3ae0001bf0 con 0x7f3aec093ae0 2021-02-06T22:52:24.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4190910275 0 0) 0x7f3aec13a930 con 0x7f3aec12cd30 2021-02-06T22:52:24.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.106:6789/0 conn(0x7f3aec093ec0 legacy=0x7f3aec12bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.51:6789/0 conn(0x7f3aec093ae0 legacy=0x7f3aec139a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.578+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec126840 con 0x7f3aec12cd30 2021-02-06T22:52:24.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec124690 con 0x7f3aec12cd30 2021-02-06T22:52:24.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec12c400 con 0x7f3aec12cd30 2021-02-06T22:52:24.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 1 librados: init done 2021-02-06T22:52:24.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3ae40025b0 con 0x7f3aec12cd30 2021-02-06T22:52:24.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3ae40028c0 con 0x7f3aec12cd30 2021-02-06T22:52:24.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 10 client.4235.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 15 client.4235.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 20 client.4235.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ac4002870 con 0x7f3aec12cd30 2021-02-06T22:52:24.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.579+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3ae4002aa0 con 0x7f3aec12cd30 2021-02-06T22:52:24.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3ae40397b0 con 0x7f3aec12cd30 2021-02-06T22:52:24.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 10 client.4235.objecter ms_dispatch 0x7f3aec001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 3 client.4235.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 3 client.4235.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 10 client.4235.objecter checking command 1 2021-02-06T22:52:24.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter _get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 15 client.4235.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter _get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 15 client.4235.objecter _session_command_op_assign 3 1 2021-02-06T22:52:24.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 4 2021-02-06T22:52:24.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 10 client.4235.objecter _send_command 1 2021-02-06T22:52:24.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.106:6804/33663 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3acc03afc0 con 0x7f3acc037330 2021-02-06T22:52:24.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 20 client.4235.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.580+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f3ae4039c20 con 0x7f3aec12cd30 2021-02-06T22:52:24.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.582+0000 7f3ae8ff9700 10 client.4235.objecter ms_handle_connect 0x7f3acc0307d0 2021-02-06T22:52:24.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.585+0000 7f3ae8ff9700 10 client.4235.objecter ms_handle_connect 0x7f3acc037330 2021-02-06T22:52:24.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.586+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== osd.3 v1:172.21.15.106:6804/33663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f3acc03afc0 con 0x7f3acc037330 2021-02-06T22:52:24.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.586+0000 7f3ae8ff9700 10 client.4235.objecter ms_dispatch 0x7f3aec001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.586+0000 7f3ae8ff9700 10 client.4235.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.586+0000 7f3ae8ff9700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 4 2021-02-06T22:52:24.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.586+0000 7f3ae8ff9700 15 client.4235.objecter _session_command_op_remove 3 1 2021-02-06T22:52:24.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 10 client.4235.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 15 client.4235.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 20 client.4235.objecter _get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 20 client.4235.objecter _get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 15 client.4235.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 20 client.4235.objecter get_session s=0x7f3acc036c80 osd=3 3 2021-02-06T22:52:24.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 15 client.4235.objecter _session_command_op_assign 3 2 2021-02-06T22:52:24.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 4 2021-02-06T22:52:24.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 10 client.4235.objecter _send_command 2 2021-02-06T22:52:24.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.602+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 --> v1:172.21.15.106:6804/33663 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ac4001100 con 0x7f3acc037330 2021-02-06T22:52:24.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3ae8ff9700 1 -- 172.21.15.51:0/764529555 <== osd.3 v1:172.21.15.106:6804/33663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2570787547) 0x7f3ac4001100 con 0x7f3acc037330 2021-02-06T22:52:24.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3ae8ff9700 10 client.4235.objecter ms_dispatch 0x7f3aec001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3ae8ff9700 10 client.4235.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3ae8ff9700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 4 2021-02-06T22:52:24.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3ae8ff9700 15 client.4235.objecter _session_command_op_remove 3 2 2021-02-06T22:52:24.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 10 librados: watch_flush enter 2021-02-06T22:52:24.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 10 librados: watch_flush exit 2021-02-06T22:52:24.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 10 client.4235.objecter close_session for osd.3 2021-02-06T22:52:24.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.106:6804/33663 conn(0x7f3acc037330 legacy=0x7f3acc039750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 20 client.4235.objecter put_session s=0x7f3acc036c80 osd=3 1 2021-02-06T22:52:24.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 20 client.4235.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 10 client.4235.objecter successfully canceled tick 2021-02-06T22:52:24.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.106:6812/33219 conn(0x7f3acc0307d0 legacy=0x7f3acc032c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 >> v1:172.21.15.51:6790/0 conn(0x7f3aec12cd30 legacy=0x7f3aec141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af139e700 1 -- 172.21.15.51:0/764529555 reap_dead start 2021-02-06T22:52:24.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 shutdown_connections 2021-02-06T22:52:24.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 >> 172.21.15.51:0/764529555 conn(0x7f3aec0990c0 msgr2=0x7f3aec0988d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 shutdown_connections 2021-02-06T22:52:24.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 -- 172.21.15.51:0/764529555 wait complete. 2021-02-06T22:52:24.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.603+0000 7f3af1b9f700 1 librados: shutdown 2021-02-06T22:52:24.613 INFO:teuthology.orchestra.run.smithi051.stdout:47244640258 2021-02-06T22:52:24.614 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2021-02-06T22:52:24.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.738+0000 7f7c65b54700 1 Processor -- start 2021-02-06T22:52:24.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.738+0000 7f7c65b54700 1 -- start start 2021-02-06T22:52:24.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c65b54700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c600998a0 con 0x7f7c60097200 2021-02-06T22:52:24.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c65b54700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c60099b10 con 0x7f7c60093e80 2021-02-06T22:52:24.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c65b54700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c60099db0 con 0x7f7c600976b0 2021-02-06T22:52:24.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c5ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f7c600976b0 0x7f7c601331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59756/0 (socket says 172.21.15.51:59756) 2021-02-06T22:52:24.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c5effd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 0x7f7c6012fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59414/0 (socket says 172.21.15.51:59414) 2021-02-06T22:52:24.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.739+0000 7f7c5ffff700 1 -- 172.21.15.51:0/1917174219 learned_addr learned my addr 172.21.15.51:0/1917174219 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5effd700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 legacy=0x7f7c6012fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5ffff700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.51:6790/0 conn(0x7f7c600976b0 legacy=0x7f7c601331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027729198 0 0) 0x7f7c600998a0 con 0x7f7c60097200 2021-02-06T22:52:24.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4c003230 con 0x7f7c60097200 2021-02-06T22:52:24.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48078727 0 0) 0x7f7c60099db0 con 0x7f7c600976b0 2021-02-06T22:52:24.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.741+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c600998a0 con 0x7f7c600976b0 2021-02-06T22:52:24.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5f7fe700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.106:6789/0 conn(0x7f7c60093e80 legacy=0x7f7c601278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2313192359 0 0) 0x7f7c4c003230 con 0x7f7c60097200 2021-02-06T22:52:24.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.51:6790/0 conn(0x7f7c600976b0 legacy=0x7f7c601331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.106:6789/0 conn(0x7f7c60093e80 legacy=0x7f7c601278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60127480 con 0x7f7c60097200 2021-02-06T22:52:24.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c54001930 con 0x7f7c60097200 2021-02-06T22:52:24.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5effd700 1 --1- 172.21.15.51:0/1917174219 >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 0x7f7c6012fa70 :-1 s=OPENED pgs=81 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f7c54004690 mon_map magic: 0 v1 2021-02-06T22:52:24.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c54001c40 con 0x7f7c60097200 2021-02-06T22:52:24.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c65b54700 1 -- 172.21.15.51:0/1917174219 >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 legacy=0x7f7c6012fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c5e7fc700 1 -- 172.21.15.51:0/1917174219 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c54004690 con 0x7f7c60097200 2021-02-06T22:52:24.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c65b54700 1 -- 172.21.15.51:0/1917174219 shutdown_connections 2021-02-06T22:52:24.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c65b54700 1 -- 172.21.15.51:0/1917174219 >> 172.21.15.51:0/1917174219 conn(0x7f7c6009ae00 msgr2=0x7f7c6009d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c65b54700 1 -- 172.21.15.51:0/1917174219 shutdown_connections 2021-02-06T22:52:24.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.742+0000 7f7c65b54700 1 -- 172.21.15.51:0/1917174219 wait complete. 2021-02-06T22:52:24.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 librados: starting msgr at 2021-02-06T22:52:24.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 librados: starting objecter 2021-02-06T22:52:24.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 Processor -- start 2021-02-06T22:52:24.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 -- start start 2021-02-06T22:52:24.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 librados: setting wanted keys 2021-02-06T22:52:24.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.743+0000 7f7c65b54700 1 librados: calling monclient init 2021-02-06T22:52:24.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.744+0000 7f7c65b54700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c60120df0 con 0x7f7c60097200 2021-02-06T22:52:24.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.744+0000 7f7c65b54700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c60122c30 con 0x7f7c600976b0 2021-02-06T22:52:24.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.744+0000 7f7c65b54700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c60122ed0 con 0x7f7c60093e80 2021-02-06T22:52:24.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.744+0000 7f7c5f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f7c60093e80 0x7f7c601335b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59762/0 (socket says 172.21.15.51:59762) 2021-02-06T22:52:24.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.744+0000 7f7c5f7fe700 1 -- 172.21.15.51:0/1874821264 learned_addr learned my addr 172.21.15.51:0/1874821264 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c5f7fe700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.51:6790/0 conn(0x7f7c60093e80 legacy=0x7f7c601335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c5effd700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 legacy=0x7f7c60133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter ms_handle_connect 0x7f7c60093e80 2021-02-06T22:52:24.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter ms_handle_connect 0x7f7c60097200 2021-02-06T22:52:24.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter ms_handle_connect 0x7f7c600976b0 2021-02-06T22:52:24.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c5ffff700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.106:6789/0 conn(0x7f7c600976b0 legacy=0x7f7c60142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193788370 0 0) 0x7f7c60122ed0 con 0x7f7c60093e80 2021-02-06T22:52:24.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c40004bd0 con 0x7f7c60093e80 2021-02-06T22:52:24.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514942828 0 0) 0x7f7c60120df0 con 0x7f7c60097200 2021-02-06T22:52:24.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c60122ed0 con 0x7f7c60097200 2021-02-06T22:52:24.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975676287 0 0) 0x7f7c60122c30 con 0x7f7c600976b0 2021-02-06T22:52:24.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.746+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c60120df0 con 0x7f7c600976b0 2021-02-06T22:52:24.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1913709698 0 0) 0x7f7c40004bd0 con 0x7f7c60093e80 2021-02-06T22:52:24.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c60122c30 con 0x7f7c60093e80 2021-02-06T22:52:24.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c50001c60 con 0x7f7c60093e80 2021-02-06T22:52:24.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 480600355 0 0) 0x7f7c60122ed0 con 0x7f7c60097200 2021-02-06T22:52:24.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c40004bd0 con 0x7f7c60097200 2021-02-06T22:52:24.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c540012e0 con 0x7f7c60097200 2021-02-06T22:52:24.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4109314321 0 0) 0x7f7c60120df0 con 0x7f7c600976b0 2021-02-06T22:52:24.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7c60122ed0 con 0x7f7c600976b0 2021-02-06T22:52:24.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c58002070 con 0x7f7c600976b0 2021-02-06T22:52:24.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2887003109 0 0) 0x7f7c60122c30 con 0x7f7c60093e80 2021-02-06T22:52:24.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.106:6789/0 conn(0x7f7c600976b0 legacy=0x7f7c60142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.51:6789/0 conn(0x7f7c60097200 legacy=0x7f7c60133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c600995a0 con 0x7f7c60093e80 2021-02-06T22:52:24.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60120470 con 0x7f7c60093e80 2021-02-06T22:52:24.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c65b54700 10 client.4241.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c60123880 con 0x7f7c60093e80 2021-02-06T22:52:24.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c65b54700 1 librados: init done 2021-02-06T22:52:24.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7c50002300 con 0x7f7c60093e80 2021-02-06T22:52:24.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.747+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7c50002610 con 0x7f7c60093e80 2021-02-06T22:52:24.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f7c50002820 con 0x7f7c60093e80 2021-02-06T22:52:24.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c65b54700 10 client.4241.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c65b54700 15 client.4241.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c65b54700 20 client.4241.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c65b54700 10 client.4241.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c38002870 con 0x7f7c60093e80 2021-02-06T22:52:24.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f7c500394f0 con 0x7f7c60093e80 2021-02-06T22:52:24.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 10 client.4241.objecter ms_dispatch 0x7f7c60001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 3 client.4241.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 3 client.4241.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 10 client.4241.objecter checking command 1 2021-02-06T22:52:24.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter _get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 15 client.4241.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter _get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 15 client.4241.objecter _session_command_op_assign 4 1 2021-02-06T22:52:24.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 4 2021-02-06T22:52:24.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 10 client.4241.objecter _send_command 1 2021-02-06T22:52:24.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.106:6800/33664 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c4003adc0 con 0x7f7c40037130 2021-02-06T22:52:24.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 20 client.4241.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.748+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f7c50012150 con 0x7f7c60093e80 2021-02-06T22:52:24.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.750+0000 7f7c477fe700 10 client.4241.objecter ms_handle_connect 0x7f7c400307c0 2021-02-06T22:52:24.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.753+0000 7f7c477fe700 10 client.4241.objecter ms_handle_connect 0x7f7c40037130 2021-02-06T22:52:24.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.754+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== osd.4 v1:172.21.15.106:6800/33664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f7c4003adc0 con 0x7f7c40037130 2021-02-06T22:52:24.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.754+0000 7f7c477fe700 10 client.4241.objecter ms_dispatch 0x7f7c60001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.754+0000 7f7c477fe700 10 client.4241.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.754+0000 7f7c477fe700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 4 2021-02-06T22:52:24.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.754+0000 7f7c477fe700 15 client.4241.objecter _session_command_op_remove 4 1 2021-02-06T22:52:24.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 10 client.4241.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 15 client.4241.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 20 client.4241.objecter _get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 20 client.4241.objecter _get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 15 client.4241.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 20 client.4241.objecter get_session s=0x7f7c540012e0 osd=4 3 2021-02-06T22:52:24.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 15 client.4241.objecter _session_command_op_assign 4 2 2021-02-06T22:52:24.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 4 2021-02-06T22:52:24.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 10 client.4241.objecter _send_command 2 2021-02-06T22:52:24.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.770+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 --> v1:172.21.15.106:6800/33664 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c38001100 con 0x7f7c40037130 2021-02-06T22:52:24.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c477fe700 1 -- 172.21.15.51:0/1874821264 <== osd.4 v1:172.21.15.106:6800/33664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2570787547) 0x7f7c38001100 con 0x7f7c40037130 2021-02-06T22:52:24.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c477fe700 10 client.4241.objecter ms_dispatch 0x7f7c60001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c477fe700 10 client.4241.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c477fe700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 4 2021-02-06T22:52:24.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c477fe700 15 client.4241.objecter _session_command_op_remove 4 2 2021-02-06T22:52:24.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 10 librados: watch_flush enter 2021-02-06T22:52:24.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 10 librados: watch_flush exit 2021-02-06T22:52:24.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 10 client.4241.objecter close_session for osd.4 2021-02-06T22:52:24.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.106:6800/33664 conn(0x7f7c40037130 legacy=0x7f7c40039550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 20 client.4241.objecter put_session s=0x7f7c540012e0 osd=4 1 2021-02-06T22:52:24.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 20 client.4241.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 10 client.4241.objecter successfully canceled tick 2021-02-06T22:52:24.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.106:6812/33219 conn(0x7f7c400307c0 legacy=0x7f7c40032c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 >> v1:172.21.15.51:6790/0 conn(0x7f7c60093e80 legacy=0x7f7c601335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c5ffff700 1 -- 172.21.15.51:0/1874821264 reap_dead start 2021-02-06T22:52:24.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 shutdown_connections 2021-02-06T22:52:24.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 >> 172.21.15.51:0/1874821264 conn(0x7f7c6009ae00 msgr2=0x7f7c600951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 shutdown_connections 2021-02-06T22:52:24.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.771+0000 7f7c65b54700 1 -- 172.21.15.51:0/1874821264 wait complete. 2021-02-06T22:52:24.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.772+0000 7f7c65b54700 1 librados: shutdown 2021-02-06T22:52:24.782 INFO:teuthology.orchestra.run.smithi051.stdout:47244640258 2021-02-06T22:52:24.782 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2021-02-06T22:52:24.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6b12c3700 1 Processor -- start 2021-02-06T22:52:24.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6b12c3700 1 -- start start 2021-02-06T22:52:24.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6b12c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac095050 con 0x7fb6ac067ec0 2021-02-06T22:52:24.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6b12c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac128c00 con 0x7fb6ac067a30 2021-02-06T22:52:24.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6b12c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac095280 con 0x7fb6ac0999a0 2021-02-06T22:52:24.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6ab7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067ec0 0x7fb6ac130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59430/0 (socket says 172.21.15.51:59430) 2021-02-06T22:52:24.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.906+0000 7fb6ab7fe700 1 -- 172.21.15.51:0/3560392124 learned_addr learned my addr 172.21.15.51:0/3560392124 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6ab7fe700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067ec0 legacy=0x7fb6ac130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6aaffd700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.51:6790/0 conn(0x7fb6ac0999a0 legacy=0x7fb6ac1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6aa7fc700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.106:6789/0 conn(0x7fb6ac067a30 legacy=0x7fb6ac12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348552020 0 0) 0x7fb6ac095050 con 0x7fb6ac067ec0 2021-02-06T22:52:24.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb698003230 con 0x7fb6ac067ec0 2021-02-06T22:52:24.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289859065 0 0) 0x7fb6ac095280 con 0x7fb6ac0999a0 2021-02-06T22:52:24.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac095050 con 0x7fb6ac0999a0 2021-02-06T22:52:24.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878011844 0 0) 0x7fb6ac128c00 con 0x7fb6ac067a30 2021-02-06T22:52:24.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac095280 con 0x7fb6ac067a30 2021-02-06T22:52:24.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 706158662 0 0) 0x7fb6ac095050 con 0x7fb6ac0999a0 2021-02-06T22:52:24.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.106:6789/0 conn(0x7fb6ac067a30 legacy=0x7fb6ac12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067ec0 legacy=0x7fb6ac130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac095520 con 0x7fb6ac0999a0 2021-02-06T22:52:24.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.909+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6a00019a0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb6a0001cb0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6a9ffb700 1 -- 172.21.15.51:0/3560392124 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6a0002060 con 0x7fb6ac0999a0 2021-02-06T22:52:24.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6b12c3700 1 -- 172.21.15.51:0/3560392124 >> v1:172.21.15.51:6790/0 conn(0x7fb6ac0999a0 legacy=0x7fb6ac1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6b12c3700 1 -- 172.21.15.51:0/3560392124 shutdown_connections 2021-02-06T22:52:24.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6b12c3700 1 -- 172.21.15.51:0/3560392124 >> 172.21.15.51:0/3560392124 conn(0x7fb6ac096860 msgr2=0x7fb6ac099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6b12c3700 1 -- 172.21.15.51:0/3560392124 shutdown_connections 2021-02-06T22:52:24.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.910+0000 7fb6b12c3700 1 -- 172.21.15.51:0/3560392124 wait complete. 2021-02-06T22:52:24.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 librados: starting msgr at 2021-02-06T22:52:24.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 librados: starting objecter 2021-02-06T22:52:24.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 Processor -- start 2021-02-06T22:52:24.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 -- start start 2021-02-06T22:52:24.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 librados: setting wanted keys 2021-02-06T22:52:24.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 librados: calling monclient init 2021-02-06T22:52:24.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac1312d0 con 0x7fb6ac067a30 2021-02-06T22:52:24.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac093230 con 0x7fb6ac0999a0 2021-02-06T22:52:24.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.911+0000 7fb6b12c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac131500 con 0x7fb6ac067ec0 2021-02-06T22:52:24.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.912+0000 7fb6aaffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067a30 0x7fb6ac091190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59436/0 (socket says 172.21.15.51:59436) 2021-02-06T22:52:24.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.912+0000 7fb6aaffd700 1 -- 172.21.15.51:0/1517071444 learned_addr learned my addr 172.21.15.51:0/1517071444 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:24.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6aa7fc700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.51:6790/0 conn(0x7fb6ac067ec0 legacy=0x7fb6ac13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6aaffd700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067a30 legacy=0x7fb6ac091190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter ms_handle_connect 0x7fb6ac067ec0 2021-02-06T22:52:24.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter ms_handle_connect 0x7fb6ac067a30 2021-02-06T22:52:24.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6ab7fe700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.106:6789/0 conn(0x7fb6ac0999a0 legacy=0x7fb6ac142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:24.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595508359 0 0) 0x7fb6ac131500 con 0x7fb6ac067ec0 2021-02-06T22:52:24.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb68c004bd0 con 0x7fb6ac067ec0 2021-02-06T22:52:24.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter ms_handle_connect 0x7fb6ac0999a0 2021-02-06T22:52:24.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:24.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659517450 0 0) 0x7fb6ac1312d0 con 0x7fb6ac067a30 2021-02-06T22:52:24.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac131500 con 0x7fb6ac067a30 2021-02-06T22:52:24.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25672156 0 0) 0x7fb6ac093230 con 0x7fb6ac0999a0 2021-02-06T22:52:24.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ac1312d0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2971637830 0 0) 0x7fb6ac131500 con 0x7fb6ac067a30 2021-02-06T22:52:24.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6ac093230 con 0x7fb6ac067a30 2021-02-06T22:52:24.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6a0001960 con 0x7fb6ac067a30 2021-02-06T22:52:24.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2526978260 0 0) 0x7fb68c004bd0 con 0x7fb6ac067ec0 2021-02-06T22:52:24.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6ac131500 con 0x7fb6ac067ec0 2021-02-06T22:52:24.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb69c001920 con 0x7fb6ac067ec0 2021-02-06T22:52:24.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2570603524 0 0) 0x7fb6ac1312d0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb68c004bd0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6a4001fe0 con 0x7fb6ac0999a0 2021-02-06T22:52:24.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2135011445 0 0) 0x7fb6ac093230 con 0x7fb6ac067a30 2021-02-06T22:52:24.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.51:6790/0 conn(0x7fb6ac067ec0 legacy=0x7fb6ac13ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.106:6789/0 conn(0x7fb6ac0999a0 legacy=0x7fb6ac142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac092480 con 0x7fb6ac067a30 2021-02-06T22:52:24.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac130960 con 0x7fb6ac067a30 2021-02-06T22:52:24.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6b12c3700 10 client.4260.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac0918a0 con 0x7fb6ac067a30 2021-02-06T22:52:24.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.914+0000 7fb6b12c3700 1 librados: init done 2021-02-06T22:52:24.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb6a00015d0 con 0x7fb6ac067a30 2021-02-06T22:52:24.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6a0002910 con 0x7fb6ac067a30 2021-02-06T22:52:24.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fb6a0002ab0 con 0x7fb6ac067a30 2021-02-06T22:52:24.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb6b12c3700 10 client.4260.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:52:24.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb6b12c3700 15 client.4260.objecter _session_command_op_assign -1 1 2021-02-06T22:52:24.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb6b12c3700 20 client.4260.objecter _get_session osd=-1 returning homeless 2021-02-06T22:52:24.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb6b12c3700 10 client.4260.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:24.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.51:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb684002870 con 0x7fb6ac067a30 2021-02-06T22:52:24.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fb6a00396c0 con 0x7fb6ac067a30 2021-02-06T22:52:24.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 10 client.4260.objecter ms_dispatch 0x7fb6ac001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:24.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 3 client.4260.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:24.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 3 client.4260.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:24.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.915+0000 7fb692ffd700 10 client.4260.objecter checking command 1 2021-02-06T22:52:24.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter _get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 15 client.4260.objecter _session_command_op_remove -1 1 2021-02-06T22:52:24.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter _get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 15 client.4260.objecter _session_command_op_assign 5 1 2021-02-06T22:52:24.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 4 2021-02-06T22:52:24.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 10 client.4260.objecter _send_command 1 2021-02-06T22:52:24.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.106:6805/33665 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb68c03aef0 con 0x7fb68c037260 2021-02-06T22:52:24.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 20 client.4260.objecter dump_active .. 0 homeless 2021-02-06T22:52:24.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.916+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fb6a0012670 con 0x7fb6ac067a30 2021-02-06T22:52:24.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.918+0000 7fb692ffd700 10 client.4260.objecter ms_handle_connect 0x7fb68c030820 2021-02-06T22:52:24.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.920+0000 7fb692ffd700 10 client.4260.objecter ms_handle_connect 0x7fb68c037260 2021-02-06T22:52:24.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.921+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== osd.5 v1:172.21.15.106:6805/33665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7fb68c03aef0 con 0x7fb68c037260 2021-02-06T22:52:24.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.921+0000 7fb692ffd700 10 client.4260.objecter ms_dispatch 0x7fb6ac001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:52:24.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.921+0000 7fb692ffd700 10 client.4260.objecter _finish_command 1 = system:0 2021-02-06T22:52:24.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.921+0000 7fb692ffd700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 4 2021-02-06T22:52:24.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.921+0000 7fb692ffd700 15 client.4260.objecter _session_command_op_remove 5 1 2021-02-06T22:52:24.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 10 client.4260.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2021-02-06T22:52:24.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 15 client.4260.objecter _session_command_op_assign -1 2 2021-02-06T22:52:24.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 20 client.4260.objecter _get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 20 client.4260.objecter _get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 15 client.4260.objecter _session_command_op_remove -1 2 2021-02-06T22:52:24.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 20 client.4260.objecter get_session s=0x7fb68c036bb0 osd=5 3 2021-02-06T22:52:24.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 15 client.4260.objecter _session_command_op_assign 5 2 2021-02-06T22:52:24.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 4 2021-02-06T22:52:24.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 10 client.4260.objecter _send_command 2 2021-02-06T22:52:24.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.938+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 --> v1:172.21.15.106:6805/33665 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb684001100 con 0x7fb68c037260 2021-02-06T22:52:24.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb692ffd700 1 -- 172.21.15.51:0/1517071444 <== osd.5 v1:172.21.15.106:6805/33665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1800444376) 0x7fb684001100 con 0x7fb68c037260 2021-02-06T22:52:24.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb692ffd700 10 client.4260.objecter ms_dispatch 0x7fb6ac001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:52:24.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb692ffd700 10 client.4260.objecter _finish_command 2 = system:0 2021-02-06T22:52:24.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb692ffd700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 4 2021-02-06T22:52:24.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb692ffd700 15 client.4260.objecter _session_command_op_remove 5 2 2021-02-06T22:52:24.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 10 librados: watch_flush enter 2021-02-06T22:52:24.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 10 librados: watch_flush exit 2021-02-06T22:52:24.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 10 client.4260.objecter close_session for osd.5 2021-02-06T22:52:24.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.106:6805/33665 conn(0x7fb68c037260 legacy=0x7fb68c039680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 20 client.4260.objecter put_session s=0x7fb68c036bb0 osd=5 1 2021-02-06T22:52:24.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 20 client.4260.objecter shutdown clearing up homeless session... 2021-02-06T22:52:24.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 10 client.4260.objecter successfully canceled tick 2021-02-06T22:52:24.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.106:6812/33219 conn(0x7fb68c030820 legacy=0x7fb68c032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 >> v1:172.21.15.51:6789/0 conn(0x7fb6ac067a30 legacy=0x7fb6ac091190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:24.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6ab7fe700 1 -- 172.21.15.51:0/1517071444 reap_dead start 2021-02-06T22:52:24.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 shutdown_connections 2021-02-06T22:52:24.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 >> 172.21.15.51:0/1517071444 conn(0x7fb6ac096860 msgr2=0x7fb6ac097bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:24.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 shutdown_connections 2021-02-06T22:52:24.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 -- 172.21.15.51:0/1517071444 wait complete. 2021-02-06T22:52:24.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:24.939+0000 7fb6b12c3700 1 librados: shutdown 2021-02-06T22:52:24.949 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:24.950 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2021-02-06T22:52:25.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.074+0000 7f880a29e700 1 Processor -- start 2021-02-06T22:52:25.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.074+0000 7f880a29e700 1 -- start start 2021-02-06T22:52:25.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f880a29e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880408ef70 con 0x7f8804090d50 2021-02-06T22:52:25.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f880a29e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880408f440 con 0x7f8804062530 2021-02-06T22:52:25.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f880a29e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040620b0 con 0x7f88040908f0 2021-02-06T22:52:25.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f880883b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8804090d50 0x7f88041331e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59446/0 (socket says 172.21.15.51:59446) 2021-02-06T22:52:25.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f88037fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f88040908f0 0x7f880412fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59788/0 (socket says 172.21.15.51:59788) 2021-02-06T22:52:25.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.075+0000 7f880883b700 1 -- 172.21.15.51:0/350503826 learned_addr learned my addr 172.21.15.51:0/350503826 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f880883b700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.51:6789/0 conn(0x7f8804090d50 legacy=0x7f88041331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f88037fe700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.51:6790/0 conn(0x7f88040908f0 legacy=0x7f880412fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8803fff700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.106:6789/0 conn(0x7f8804062530 legacy=0x7f88040619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937228665 0 0) 0x7f880408ef70 con 0x7f8804090d50 2021-02-06T22:52:25.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f0003230 con 0x7f8804090d50 2021-02-06T22:52:25.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675305580 0 0) 0x7f88040620b0 con 0x7f88040908f0 2021-02-06T22:52:25.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880408ef70 con 0x7f88040908f0 2021-02-06T22:52:25.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2611743099 0 0) 0x7f880408ef70 con 0x7f88040908f0 2021-02-06T22:52:25.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.106:6789/0 conn(0x7f8804062530 legacy=0x7f88040619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.51:6789/0 conn(0x7f8804090d50 legacy=0x7f88041331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804096470 con 0x7f88040908f0 2021-02-06T22:52:25.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.077+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f87f4001930 con 0x7f88040908f0 2021-02-06T22:52:25.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f87f4001cd0 con 0x7f88040908f0 2021-02-06T22:52:25.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f8802ffd700 1 -- 172.21.15.51:0/350503826 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f87f4004690 con 0x7f88040908f0 2021-02-06T22:52:25.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f880a29e700 1 -- 172.21.15.51:0/350503826 >> v1:172.21.15.51:6790/0 conn(0x7f88040908f0 legacy=0x7f880412fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f880a29e700 1 -- 172.21.15.51:0/350503826 shutdown_connections 2021-02-06T22:52:25.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f880a29e700 1 -- 172.21.15.51:0/350503826 >> 172.21.15.51:0/350503826 conn(0x7f880409b010 msgr2=0x7f8804096e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f880a29e700 1 -- 172.21.15.51:0/350503826 shutdown_connections 2021-02-06T22:52:25.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.078+0000 7f880a29e700 1 -- 172.21.15.51:0/350503826 wait complete. 2021-02-06T22:52:25.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 librados: starting msgr at 2021-02-06T22:52:25.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 librados: starting objecter 2021-02-06T22:52:25.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 Processor -- start 2021-02-06T22:52:25.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 -- start start 2021-02-06T22:52:25.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 librados: setting wanted keys 2021-02-06T22:52:25.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.079+0000 7f880a29e700 1 librados: calling monclient init 2021-02-06T22:52:25.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f880a29e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880413ac80 con 0x7f88040908f0 2021-02-06T22:52:25.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f880a29e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8804123e50 con 0x7f8804062530 2021-02-06T22:52:25.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f880a29e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88041240f0 con 0x7f8804090d50 2021-02-06T22:52:25.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f88037fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f88040908f0 0x7f880413a570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59454/0 (socket says 172.21.15.51:59454) 2021-02-06T22:52:25.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f88037fe700 1 -- 172.21.15.51:0/1855664720 learned_addr learned my addr 172.21.15.51:0/1855664720 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.080+0000 7f880883b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8804090d50 0x7f88041421f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59798/0 (socket says 172.21.15.51:59798) 2021-02-06T22:52:25.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f880883b700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.51:6790/0 conn(0x7f8804090d50 legacy=0x7f88041421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f88037fe700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.51:6789/0 conn(0x7f88040908f0 legacy=0x7f880413a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter ms_handle_connect 0x7f8804090d50 2021-02-06T22:52:25.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter ms_handle_connect 0x7f88040908f0 2021-02-06T22:52:25.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936650323 0 0) 0x7f88041240f0 con 0x7f8804090d50 2021-02-06T22:52:25.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e4004bd0 con 0x7f8804090d50 2021-02-06T22:52:25.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112484716 0 0) 0x7f880413ac80 con 0x7f88040908f0 2021-02-06T22:52:25.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88041240f0 con 0x7f88040908f0 2021-02-06T22:52:25.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter ms_handle_connect 0x7f8804062530 2021-02-06T22:52:25.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f8803fff700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.106:6789/0 conn(0x7f8804062530 legacy=0x7f8804139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 767331271 0 0) 0x7f88041240f0 con 0x7f88040908f0 2021-02-06T22:52:25.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f880413ac80 con 0x7f88040908f0 2021-02-06T22:52:25.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3393374223 0 0) 0x7f87e4004bd0 con 0x7f8804090d50 2021-02-06T22:52:25.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f88041240f0 con 0x7f8804090d50 2021-02-06T22:52:25.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f87f40018f0 con 0x7f88040908f0 2021-02-06T22:52:25.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f87fc002030 con 0x7f8804090d50 2021-02-06T22:52:25.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270411153 0 0) 0x7f8804123e50 con 0x7f8804062530 2021-02-06T22:52:25.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e4004bd0 con 0x7f8804062530 2021-02-06T22:52:25.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1463569388 0 0) 0x7f88041240f0 con 0x7f8804090d50 2021-02-06T22:52:25.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.106:6789/0 conn(0x7f8804062530 legacy=0x7f8804139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.51:6789/0 conn(0x7f88040908f0 legacy=0x7f880413a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.082+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8804124390 con 0x7f8804090d50 2021-02-06T22:52:25.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880412ad50 con 0x7f8804090d50 2021-02-06T22:52:25.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f880a29e700 10 client.4253.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:25.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f88041247d0 con 0x7f8804090d50 2021-02-06T22:52:25.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f880a29e700 1 librados: init done 2021-02-06T22:52:25.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f87fc004b70 con 0x7f8804090d50 2021-02-06T22:52:25.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f87fc004e80 con 0x7f8804090d50 2021-02-06T22:52:25.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.083+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f87fc005060 con 0x7f8804090d50 2021-02-06T22:52:25.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f87fc039620 con 0x7f8804090d50 2021-02-06T22:52:25.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f87ebfff700 10 client.4253.objecter ms_dispatch 0x7f8804001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:25.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f87ebfff700 3 client.4253.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:25.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f87ebfff700 3 client.4253.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:25.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f87ebfff700 20 client.4253.objecter dump_active .. 0 homeless 2021-02-06T22:52:25.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.084+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87dc004d60 con 0x7f8804090d50 2021-02-06T22:52:25.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.086+0000 7f87ebfff700 10 client.4253.objecter ms_handle_connect 0x7f87e4030760 2021-02-06T22:52:25.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.088+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f87fc012510 con 0x7f8804090d50 2021-02-06T22:52:25.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.273+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f87dc005430 con 0x7f8804090d50 2021-02-06T22:52:25.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.273+0000 7f87ebfff700 1 -- 172.21.15.51:0/1855664720 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 847495621) 0x7f87fc012100 con 0x7f8804090d50 2021-02-06T22:52:25.273 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:25.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 10 librados: watch_flush enter 2021-02-06T22:52:25.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 10 librados: watch_flush exit 2021-02-06T22:52:25.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 20 client.4253.objecter shutdown clearing up homeless session... 2021-02-06T22:52:25.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 10 client.4253.objecter successfully canceled tick 2021-02-06T22:52:25.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.106:6812/33219 conn(0x7f87e4030760 legacy=0x7f87e4032c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 >> v1:172.21.15.51:6790/0 conn(0x7f8804090d50 legacy=0x7f88041421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 shutdown_connections 2021-02-06T22:52:25.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.274+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 >> 172.21.15.51:0/1855664720 conn(0x7f880409b010 msgr2=0x7f8804125db0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.275+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 shutdown_connections 2021-02-06T22:52:25.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.275+0000 7f880a29e700 1 -- 172.21.15.51:0/1855664720 wait complete. 2021-02-06T22:52:25.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.275+0000 7f880a29e700 1 librados: shutdown 2021-02-06T22:52:25.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640259 for osd.0 2021-02-06T22:52:25.286 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2021-02-06T22:52:25.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.411+0000 7f3991906700 1 Processor -- start 2021-02-06T22:52:25.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.411+0000 7f3991906700 1 -- start start 2021-02-06T22:52:25.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f3991906700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0950b0 con 0x7f398c092810 2021-02-06T22:52:25.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f3991906700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c095350 con 0x7f398c08f810 2021-02-06T22:52:25.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f3991906700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0680e0 con 0x7f398c08f390 2021-02-06T22:52:25.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f3990904700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f398c092810 0x7f398c08ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59460/0 (socket says 172.21.15.51:59460) 2021-02-06T22:52:25.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f3990904700 1 -- 172.21.15.51:0/3405179869 learned_addr learned my addr 172.21.15.51:0/3405179869 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.412+0000 7f398bfff700 1 --1- 172.21.15.51:0/3405179869 >> v1:172.21.15.51:6790/0 conn(0x7f398c08f390 0x7f398c12d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59804/0 (socket says 172.21.15.51:59804) 2021-02-06T22:52:25.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f3990904700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.51:6789/0 conn(0x7f398c092810 legacy=0x7f398c08ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398bfff700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.51:6790/0 conn(0x7f398c08f390 legacy=0x7f398c12d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227353706 0 0) 0x7f398c0680e0 con 0x7f398c08f390 2021-02-06T22:52:25.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3970003230 con 0x7f398c08f390 2021-02-06T22:52:25.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f3991105700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.106:6789/0 conn(0x7f398c08f810 legacy=0x7f398c130a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614090650 0 0) 0x7f398c0950b0 con 0x7f398c092810 2021-02-06T22:52:25.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c0680e0 con 0x7f398c092810 2021-02-06T22:52:25.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210255606 0 0) 0x7f398c095350 con 0x7f398c08f810 2021-02-06T22:52:25.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c0950b0 con 0x7f398c08f810 2021-02-06T22:52:25.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2811253481 0 0) 0x7f3970003230 con 0x7f398c08f390 2021-02-06T22:52:25.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.106:6789/0 conn(0x7f398c08f810 legacy=0x7f398c130a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.51:6789/0 conn(0x7f398c092810 legacy=0x7f398c08ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c067ca0 con 0x7f398c08f390 2021-02-06T22:52:25.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39780018a0 con 0x7f398c08f390 2021-02-06T22:52:25.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3978001bb0 con 0x7f398c08f390 2021-02-06T22:52:25.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.414+0000 7f398b7fe700 1 -- 172.21.15.51:0/3405179869 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39780044f0 con 0x7f398c08f390 2021-02-06T22:52:25.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.415+0000 7f3991906700 1 -- 172.21.15.51:0/3405179869 >> v1:172.21.15.51:6790/0 conn(0x7f398c08f390 legacy=0x7f398c12d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.415+0000 7f3991906700 1 -- 172.21.15.51:0/3405179869 shutdown_connections 2021-02-06T22:52:25.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.415+0000 7f3991906700 1 -- 172.21.15.51:0/3405179869 >> 172.21.15.51:0/3405179869 conn(0x7f398c0990c0 msgr2=0x7f398c0994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.415+0000 7f3991906700 1 -- 172.21.15.51:0/3405179869 shutdown_connections 2021-02-06T22:52:25.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.415+0000 7f3991906700 1 -- 172.21.15.51:0/3405179869 wait complete. 2021-02-06T22:52:25.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 librados: starting msgr at 2021-02-06T22:52:25.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 librados: starting objecter 2021-02-06T22:52:25.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 Processor -- start 2021-02-06T22:52:25.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 -- start start 2021-02-06T22:52:25.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 librados: setting wanted keys 2021-02-06T22:52:25.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 librados: calling monclient init 2021-02-06T22:52:25.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c0942c0 con 0x7f398c08f810 2021-02-06T22:52:25.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c11eeb0 con 0x7f398c08f390 2021-02-06T22:52:25.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.416+0000 7f3991906700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398c128040 con 0x7f398c092810 2021-02-06T22:52:25.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.417+0000 7f398bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f398c08f810 0x7f398c13cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59468/0 (socket says 172.21.15.51:59468) 2021-02-06T22:52:25.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.417+0000 7f398bfff700 1 -- 172.21.15.51:0/515226355 learned_addr learned my addr 172.21.15.51:0/515226355 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f398bfff700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.51:6789/0 conn(0x7f398c08f810 legacy=0x7f398c13cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3991105700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.51:6790/0 conn(0x7f398c092810 legacy=0x7f398c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter ms_handle_connect 0x7f398c08f810 2021-02-06T22:52:25.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter ms_handle_connect 0x7f398c092810 2021-02-06T22:52:25.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089146244 0 0) 0x7f398c0942c0 con 0x7f398c08f810 2021-02-06T22:52:25.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f396c004bd0 con 0x7f398c08f810 2021-02-06T22:52:25.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279163410 0 0) 0x7f398c128040 con 0x7f398c092810 2021-02-06T22:52:25.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c0942c0 con 0x7f398c092810 2021-02-06T22:52:25.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3990904700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.106:6789/0 conn(0x7f398c08f390 legacy=0x7f398c124f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter ms_handle_connect 0x7f398c08f390 2021-02-06T22:52:25.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615925963 0 0) 0x7f398c11eeb0 con 0x7f398c08f390 2021-02-06T22:52:25.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f398c128040 con 0x7f398c08f390 2021-02-06T22:52:25.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1095300975 0 0) 0x7f398c0942c0 con 0x7f398c092810 2021-02-06T22:52:25.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f398c11eeb0 con 0x7f398c092810 2021-02-06T22:52:25.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 707927403 0 0) 0x7f396c004bd0 con 0x7f398c08f810 2021-02-06T22:52:25.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f398c0942c0 con 0x7f398c08f810 2021-02-06T22:52:25.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3984001fa0 con 0x7f398c092810 2021-02-06T22:52:25.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39780044f0 con 0x7f398c08f810 2021-02-06T22:52:25.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3078670746 0 0) 0x7f398c11eeb0 con 0x7f398c092810 2021-02-06T22:52:25.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.106:6789/0 conn(0x7f398c08f390 legacy=0x7f398c124f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.51:6789/0 conn(0x7f398c08f810 legacy=0x7f398c13cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c11fa50 con 0x7f398c092810 2021-02-06T22:52:25.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c067340 con 0x7f398c092810 2021-02-06T22:52:25.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3991906700 10 client.4259.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:25.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c066890 con 0x7f398c092810 2021-02-06T22:52:25.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3991906700 1 librados: init done 2021-02-06T22:52:25.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f39840024f0 con 0x7f398c092810 2021-02-06T22:52:25.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.419+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3984002800 con 0x7f398c092810 2021-02-06T22:52:25.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3984002a10 con 0x7f398c092810 2021-02-06T22:52:25.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3984039740 con 0x7f398c092810 2021-02-06T22:52:25.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 10 client.4259.objecter ms_dispatch 0x7f398c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:25.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 3 client.4259.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:25.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 3 client.4259.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:25.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3988ff9700 20 client.4259.objecter dump_active .. 0 homeless 2021-02-06T22:52:25.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.420+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964004d60 con 0x7f398c092810 2021-02-06T22:52:25.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.423+0000 7f3988ff9700 10 client.4259.objecter ms_handle_connect 0x7f396c030520 2021-02-06T22:52:25.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.424+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f3984002fd0 con 0x7f398c092810 2021-02-06T22:52:25.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.610+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3964005430 con 0x7f398c092810 2021-02-06T22:52:25.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.611+0000 7f3988ff9700 1 -- 172.21.15.51:0/515226355 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 847495621) 0x7f39840121c0 con 0x7f398c092810 2021-02-06T22:52:25.611 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:25.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.612+0000 7f3991906700 10 librados: watch_flush enter 2021-02-06T22:52:25.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.612+0000 7f3991906700 10 librados: watch_flush exit 2021-02-06T22:52:25.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.612+0000 7f3991906700 20 client.4259.objecter shutdown clearing up homeless session... 2021-02-06T22:52:25.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.612+0000 7f3991906700 10 client.4259.objecter successfully canceled tick 2021-02-06T22:52:25.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.106:6812/33219 conn(0x7f396c030520 legacy=0x7f396c0329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 >> v1:172.21.15.51:6790/0 conn(0x7f398c092810 legacy=0x7f398c140250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 shutdown_connections 2021-02-06T22:52:25.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 >> 172.21.15.51:0/515226355 conn(0x7f398c0990c0 msgr2=0x7f398c097d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 shutdown_connections 2021-02-06T22:52:25.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 -- 172.21.15.51:0/515226355 wait complete. 2021-02-06T22:52:25.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.613+0000 7f3991906700 1 librados: shutdown 2021-02-06T22:52:25.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2021-02-06T22:52:25.624 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2021-02-06T22:52:25.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.748+0000 7fcae61a0700 1 Processor -- start 2021-02-06T22:52:25.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.748+0000 7fcae61a0700 1 -- start start 2021-02-06T22:52:25.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae61a0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0090600 con 0x7fcae012d920 2021-02-06T22:52:25.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae61a0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae008fc50 con 0x7fcae0090c80 2021-02-06T22:52:25.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae61a0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0091690 con 0x7fcae00925b0 2021-02-06T22:52:25.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae519e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcae00925b0 0x7fcae008ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59816/0 (socket says 172.21.15.51:59816) 2021-02-06T22:52:25.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae519e700 1 -- 172.21.15.51:0/3374282802 learned_addr learned my addr 172.21.15.51:0/3374282802 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.749+0000 7fcae599f700 1 --1- 172.21.15.51:0/3374282802 >> v1:172.21.15.51:6789/0 conn(0x7fcae012d920 0x7fcae012fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59478/0 (socket says 172.21.15.51:59478) 2021-02-06T22:52:25.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcae599f700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.51:6789/0 conn(0x7fcae012d920 legacy=0x7fcae012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcae519e700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.51:6790/0 conn(0x7fcae00925b0 legacy=0x7fcae008ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826400536 0 0) 0x7fcae0090600 con 0x7fcae012d920 2021-02-06T22:52:25.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac8003230 con 0x7fcae012d920 2021-02-06T22:52:25.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80523982 0 0) 0x7fcae0091690 con 0x7fcae00925b0 2021-02-06T22:52:25.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae0090600 con 0x7fcae00925b0 2021-02-06T22:52:25.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcae499d700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.106:6789/0 conn(0x7fcae0090c80 legacy=0x7fcae008f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3447041858 0 0) 0x7fcac8003230 con 0x7fcae012d920 2021-02-06T22:52:25.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.51:6790/0 conn(0x7fcae00925b0 legacy=0x7fcae008ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.106:6789/0 conn(0x7fcae0090c80 legacy=0x7fcae008f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0091930 con 0x7fcae012d920 2021-02-06T22:52:25.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad8001cb0 con 0x7fcae012d920 2021-02-06T22:52:25.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcad8001fc0 con 0x7fcae012d920 2021-02-06T22:52:25.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.751+0000 7fcad3fff700 1 -- 172.21.15.51:0/3374282802 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad8004a10 con 0x7fcae012d920 2021-02-06T22:52:25.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.752+0000 7fcae61a0700 1 -- 172.21.15.51:0/3374282802 >> v1:172.21.15.51:6789/0 conn(0x7fcae012d920 legacy=0x7fcae012fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.752+0000 7fcae61a0700 1 -- 172.21.15.51:0/3374282802 shutdown_connections 2021-02-06T22:52:25.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.752+0000 7fcae61a0700 1 -- 172.21.15.51:0/3374282802 >> 172.21.15.51:0/3374282802 conn(0x7fcae00990c0 msgr2=0x7fcae00994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.752+0000 7fcae61a0700 1 -- 172.21.15.51:0/3374282802 shutdown_connections 2021-02-06T22:52:25.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.752+0000 7fcae61a0700 1 -- 172.21.15.51:0/3374282802 wait complete. 2021-02-06T22:52:25.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 librados: starting msgr at 2021-02-06T22:52:25.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 librados: starting objecter 2021-02-06T22:52:25.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 Processor -- start 2021-02-06T22:52:25.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 -- start start 2021-02-06T22:52:25.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 librados: setting wanted keys 2021-02-06T22:52:25.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 librados: calling monclient init 2021-02-06T22:52:25.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0110d40 con 0x7fcae00925b0 2021-02-06T22:52:25.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0110580 con 0x7fcae0090c80 2021-02-06T22:52:25.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.753+0000 7fcae61a0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae0112b10 con 0x7fcae012d920 2021-02-06T22:52:25.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.754+0000 7fcae599f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcae012d920 0x7fcae0141e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59826/0 (socket says 172.21.15.51:59826) 2021-02-06T22:52:25.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.754+0000 7fcae599f700 1 -- 172.21.15.51:0/2880336526 learned_addr learned my addr 172.21.15.51:0/2880336526 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:25.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.754+0000 7fcae499d700 1 --1- 172.21.15.51:0/2880336526 >> v1:172.21.15.51:6789/0 conn(0x7fcae00925b0 0x7fcae010fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59482/0 (socket says 172.21.15.51:59482) 2021-02-06T22:52:25.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae599f700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.51:6790/0 conn(0x7fcae012d920 legacy=0x7fcae0141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae499d700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.51:6789/0 conn(0x7fcae00925b0 legacy=0x7fcae010fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter ms_handle_connect 0x7fcae012d920 2021-02-06T22:52:25.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter ms_handle_connect 0x7fcae00925b0 2021-02-06T22:52:25.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744689882 0 0) 0x7fcae0112b10 con 0x7fcae012d920 2021-02-06T22:52:25.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac0004bd0 con 0x7fcae012d920 2021-02-06T22:52:25.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter ms_handle_connect 0x7fcae0090c80 2021-02-06T22:52:25.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:25.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae519e700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.106:6789/0 conn(0x7fcae0090c80 legacy=0x7fcae010f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:25.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982495350 0 0) 0x7fcae0110d40 con 0x7fcae00925b0 2021-02-06T22:52:25.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae0112b10 con 0x7fcae00925b0 2021-02-06T22:52:25.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044181678 0 0) 0x7fcae0110580 con 0x7fcae0090c80 2021-02-06T22:52:25.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcae0110d40 con 0x7fcae0090c80 2021-02-06T22:52:25.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4062552647 0 0) 0x7fcac0004bd0 con 0x7fcae012d920 2021-02-06T22:52:25.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcae0110580 con 0x7fcae012d920 2021-02-06T22:52:25.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad8004a10 con 0x7fcae012d920 2021-02-06T22:52:25.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2279953449 0 0) 0x7fcae0112b10 con 0x7fcae00925b0 2021-02-06T22:52:25.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcac0004bd0 con 0x7fcae00925b0 2021-02-06T22:52:25.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcadc001b60 con 0x7fcae00925b0 2021-02-06T22:52:25.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4007185934 0 0) 0x7fcae0110d40 con 0x7fcae0090c80 2021-02-06T22:52:25.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcae0112b10 con 0x7fcae0090c80 2021-02-06T22:52:25.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1287810553 0 0) 0x7fcae0110580 con 0x7fcae012d920 2021-02-06T22:52:25.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.106:6789/0 conn(0x7fcae0090c80 legacy=0x7fcae010f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.51:6789/0 conn(0x7fcae00925b0 legacy=0x7fcae010fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae0112db0 con 0x7fcae012d920 2021-02-06T22:52:25.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad4001c20 con 0x7fcae0090c80 2021-02-06T22:52:25.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae01256a0 con 0x7fcae012d920 2021-02-06T22:52:25.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae61a0700 10 client.4265.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:25.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae0113170 con 0x7fcae012d920 2021-02-06T22:52:25.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.756+0000 7fcae61a0700 1 librados: init done 2021-02-06T22:52:25.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.757+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcad80050e0 con 0x7fcae012d920 2021-02-06T22:52:25.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.757+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad8005250 con 0x7fcae012d920 2021-02-06T22:52:25.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.757+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fcad800da10 con 0x7fcae012d920 2021-02-06T22:52:25.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.757+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fcad8039a10 con 0x7fcae012d920 2021-02-06T22:52:25.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.758+0000 7fcad17fa700 10 client.4265.objecter ms_dispatch 0x7fcae0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:25.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.758+0000 7fcad17fa700 3 client.4265.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:25.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.758+0000 7fcad17fa700 3 client.4265.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:25.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.758+0000 7fcad17fa700 20 client.4265.objecter dump_active .. 0 homeless 2021-02-06T22:52:25.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.758+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab8004d60 con 0x7fcae012d920 2021-02-06T22:52:25.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.760+0000 7fcad17fa700 10 client.4265.objecter ms_handle_connect 0x7fcac0030680 2021-02-06T22:52:25.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.762+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fcad8012960 con 0x7fcae012d920 2021-02-06T22:52:25.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.943+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcab8005430 con 0x7fcae012d920 2021-02-06T22:52:25.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.944+0000 7fcad17fa700 1 -- 172.21.15.51:0/2880336526 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 1444633209) 0x7fcad8012550 con 0x7fcae012d920 2021-02-06T22:52:25.943 INFO:teuthology.orchestra.run.smithi051.stdout:47244640260 2021-02-06T22:52:25.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 10 librados: watch_flush enter 2021-02-06T22:52:25.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 10 librados: watch_flush exit 2021-02-06T22:52:25.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 20 client.4265.objecter shutdown clearing up homeless session... 2021-02-06T22:52:25.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 10 client.4265.objecter successfully canceled tick 2021-02-06T22:52:25.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.106:6812/33219 conn(0x7fcac0030680 legacy=0x7fcac0032b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 >> v1:172.21.15.51:6790/0 conn(0x7fcae012d920 legacy=0x7fcae0141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:25.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 shutdown_connections 2021-02-06T22:52:25.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 >> 172.21.15.51:0/2880336526 conn(0x7fcae00990c0 msgr2=0x7fcae0095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:25.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 shutdown_connections 2021-02-06T22:52:25.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 -- 172.21.15.51:0/2880336526 wait complete. 2021-02-06T22:52:25.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:25.945+0000 7fcae61a0700 1 librados: shutdown 2021-02-06T22:52:25.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.2 2021-02-06T22:52:25.957 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2021-02-06T22:52:26.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152ef48700 1 Processor -- start 2021-02-06T22:52:26.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152ef48700 1 -- start start 2021-02-06T22:52:26.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152ef48700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528090600 con 0x7f15280925b0 2021-02-06T22:52:26.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152ef48700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152808fc50 con 0x7f1528090c80 2021-02-06T22:52:26.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152ef48700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528091690 con 0x7f152812d920 2021-02-06T22:52:26.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152e747700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f152812d920 0x7f152812fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59834/0 (socket says 172.21.15.51:59834) 2021-02-06T22:52:26.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152df46700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f15280925b0 0x7f152808ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59488/0 (socket says 172.21.15.51:59488) 2021-02-06T22:52:26.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.081+0000 7f152e747700 1 -- 172.21.15.51:0/756266304 learned_addr learned my addr 172.21.15.51:0/756266304 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:26.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152e747700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.51:6790/0 conn(0x7f152812d920 legacy=0x7f152812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152df46700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.51:6789/0 conn(0x7f15280925b0 legacy=0x7f152808ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066404147 0 0) 0x7f1528091690 con 0x7f152812d920 2021-02-06T22:52:26.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1510003230 con 0x7f152812d920 2021-02-06T22:52:26.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182404198 0 0) 0x7f1528090600 con 0x7f15280925b0 2021-02-06T22:52:26.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1528091690 con 0x7f15280925b0 2021-02-06T22:52:26.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152d745700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.106:6789/0 conn(0x7f1528090c80 legacy=0x7f152808f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3322977606 0 0) 0x7f1510003230 con 0x7f152812d920 2021-02-06T22:52:26.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.106:6789/0 conn(0x7f1528090c80 legacy=0x7f152808f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.51:6789/0 conn(0x7f15280925b0 legacy=0x7f152808ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528091930 con 0x7f152812d920 2021-02-06T22:52:26.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1520001db0 con 0x7f152812d920 2021-02-06T22:52:26.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1520001f90 con 0x7f152812d920 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.084+0000 7f152cf44700 1 -- 172.21.15.51:0/756266304 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1520004ad0 con 0x7f152812d920 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 -- 172.21.15.51:0/756266304 >> v1:172.21.15.51:6790/0 conn(0x7f152812d920 legacy=0x7f152812fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 -- 172.21.15.51:0/756266304 shutdown_connections 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 -- 172.21.15.51:0/756266304 >> 172.21.15.51:0/756266304 conn(0x7f15280990c0 msgr2=0x7f15280994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 -- 172.21.15.51:0/756266304 shutdown_connections 2021-02-06T22:52:26.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 -- 172.21.15.51:0/756266304 wait complete. 2021-02-06T22:52:26.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 librados: starting msgr at 2021-02-06T22:52:26.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.085+0000 7f152ef48700 1 librados: starting objecter 2021-02-06T22:52:26.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 Processor -- start 2021-02-06T22:52:26.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 -- start start 2021-02-06T22:52:26.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 librados: setting wanted keys 2021-02-06T22:52:26.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 librados: calling monclient init 2021-02-06T22:52:26.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528067990 con 0x7f152812d920 2021-02-06T22:52:26.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1528126650 con 0x7f1528090c80 2021-02-06T22:52:26.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152ef48700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15281106b0 con 0x7f15280925b0 2021-02-06T22:52:26.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152d745700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f15280925b0 0x7f152813b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59838/0 (socket says 172.21.15.51:59838) 2021-02-06T22:52:26.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.086+0000 7f152d745700 1 -- 172.21.15.51:0/1070991007 learned_addr learned my addr 172.21.15.51:0/1070991007 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:26.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f152d745700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.51:6790/0 conn(0x7f15280925b0 legacy=0x7f152813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f152e747700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.51:6789/0 conn(0x7f152812d920 legacy=0x7f152813ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter ms_handle_connect 0x7f15280925b0 2021-02-06T22:52:26.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter ms_handle_connect 0x7f152812d920 2021-02-06T22:52:26.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694248291 0 0) 0x7f15281106b0 con 0x7f15280925b0 2021-02-06T22:52:26.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f152df46700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.106:6789/0 conn(0x7f1528090c80 legacy=0x7f1528125f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1508004bd0 con 0x7f15280925b0 2021-02-06T22:52:26.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter ms_handle_connect 0x7f1528090c80 2021-02-06T22:52:26.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.088+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644378164 0 0) 0x7f1528067990 con 0x7f152812d920 2021-02-06T22:52:26.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15281106b0 con 0x7f152812d920 2021-02-06T22:52:26.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19035410 0 0) 0x7f1528126650 con 0x7f1528090c80 2021-02-06T22:52:26.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1528067990 con 0x7f1528090c80 2021-02-06T22:52:26.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3148655040 0 0) 0x7f1508004bd0 con 0x7f15280925b0 2021-02-06T22:52:26.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1528126650 con 0x7f15280925b0 2021-02-06T22:52:26.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1518001bc0 con 0x7f15280925b0 2021-02-06T22:52:26.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 808015541 0 0) 0x7f15281106b0 con 0x7f152812d920 2021-02-06T22:52:26.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1508004bd0 con 0x7f152812d920 2021-02-06T22:52:26.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1520001bd0 con 0x7f152812d920 2021-02-06T22:52:26.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 646156993 0 0) 0x7f1528067990 con 0x7f1528090c80 2021-02-06T22:52:26.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15281106b0 con 0x7f1528090c80 2021-02-06T22:52:26.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1524001b90 con 0x7f1528090c80 2021-02-06T22:52:26.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1148847644 0 0) 0x7f1528126650 con 0x7f15280925b0 2021-02-06T22:52:26.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.106:6789/0 conn(0x7f1528090c80 legacy=0x7f1528125f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.51:6789/0 conn(0x7f152812d920 legacy=0x7f152813ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528110950 con 0x7f15280925b0 2021-02-06T22:52:26.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1528133940 con 0x7f15280925b0 2021-02-06T22:52:26.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f15180022f0 con 0x7f15280925b0 2021-02-06T22:52:26.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1518001ec0 con 0x7f15280925b0 2021-02-06T22:52:26.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f152ef48700 10 client.4271.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:26.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1528133280 con 0x7f15280925b0 2021-02-06T22:52:26.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.089+0000 7f152ef48700 1 librados: init done 2021-02-06T22:52:26.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f1518002640 con 0x7f15280925b0 2021-02-06T22:52:26.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f1518039420 con 0x7f15280925b0 2021-02-06T22:52:26.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 10 client.4271.objecter ms_dispatch 0x7f1528001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:26.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 3 client.4271.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:26.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 3 client.4271.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:26.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f1515ffb700 20 client.4271.objecter dump_active .. 0 homeless 2021-02-06T22:52:26.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.090+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15280581b0 con 0x7f15280925b0 2021-02-06T22:52:26.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.092+0000 7f1515ffb700 10 client.4271.objecter ms_handle_connect 0x7f15080309b0 2021-02-06T22:52:26.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.094+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f15180122b0 con 0x7f15280925b0 2021-02-06T22:52:26.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.278+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1528091130 con 0x7f15280925b0 2021-02-06T22:52:26.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.278+0000 7f1515ffb700 1 -- 172.21.15.51:0/1070991007 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (unknown 383520633 0 555833778) 0x7f1518011ea0 con 0x7f15280925b0 2021-02-06T22:52:26.278 INFO:teuthology.orchestra.run.smithi051.stdout:47244640258 2021-02-06T22:52:26.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 10 librados: watch_flush enter 2021-02-06T22:52:26.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 10 librados: watch_flush exit 2021-02-06T22:52:26.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 20 client.4271.objecter shutdown clearing up homeless session... 2021-02-06T22:52:26.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 10 client.4271.objecter successfully canceled tick 2021-02-06T22:52:26.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.106:6812/33219 conn(0x7f15080309b0 legacy=0x7f1508032e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 >> v1:172.21.15.51:6790/0 conn(0x7f15280925b0 legacy=0x7f152813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.281 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 shutdown_connections 2021-02-06T22:52:26.281 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 >> 172.21.15.51:0/1070991007 conn(0x7f15280990c0 msgr2=0x7f15281292e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:26.281 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 shutdown_connections 2021-02-06T22:52:26.281 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 -- 172.21.15.51:0/1070991007 wait complete. 2021-02-06T22:52:26.281 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.280+0000 7f152ef48700 1 librados: shutdown 2021-02-06T22:52:26.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640258 for osd.3 2021-02-06T22:52:26.291 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-02-06T22:52:26.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd535538700 1 Processor -- start 2021-02-06T22:52:26.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd535538700 1 -- start start 2021-02-06T22:52:26.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd535538700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530090db0 con 0x7fd53012cd30 2021-02-06T22:52:26.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd535538700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530091050 con 0x7fd530093ec0 2021-02-06T22:52:26.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd535538700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300912f0 con 0x7fd530093ae0 2021-02-06T22:52:26.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd52ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd530093ae0 0x7fd530091d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59844/0 (socket says 172.21.15.51:59844) 2021-02-06T22:52:26.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd52ffff700 1 -- 172.21.15.51:0/2994271510 learned_addr learned my addr 172.21.15.51:0/2994271510 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:26.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.415+0000 7fd534d37700 1 --1- 172.21.15.51:0/2994271510 >> v1:172.21.15.51:6789/0 conn(0x7fd53012cd30 0x7fd53012f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59504/0 (socket says 172.21.15.51:59504) 2021-02-06T22:52:26.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.417+0000 7fd52ffff700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.51:6790/0 conn(0x7fd530093ae0 legacy=0x7fd530091d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd534d37700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.51:6789/0 conn(0x7fd53012cd30 legacy=0x7fd53012f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762656073 0 0) 0x7fd5300912f0 con 0x7fd530093ae0 2021-02-06T22:52:26.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd51c003230 con 0x7fd530093ae0 2021-02-06T22:52:26.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2798482477 0 0) 0x7fd530090db0 con 0x7fd53012cd30 2021-02-06T22:52:26.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5300912f0 con 0x7fd53012cd30 2021-02-06T22:52:26.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52f7fe700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530094370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4004966887 0 0) 0x7fd51c003230 con 0x7fd530093ae0 2021-02-06T22:52:26.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530094370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.51:6789/0 conn(0x7fd53012cd30 legacy=0x7fd53012f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530091590 con 0x7fd530093ae0 2021-02-06T22:52:26.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd520001930 con 0x7fd530093ae0 2021-02-06T22:52:26.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd520001c40 con 0x7fd530093ae0 2021-02-06T22:52:26.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.418+0000 7fd52effd700 1 -- 172.21.15.51:0/2994271510 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd520004750 con 0x7fd530093ae0 2021-02-06T22:52:26.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 -- 172.21.15.51:0/2994271510 >> v1:172.21.15.51:6790/0 conn(0x7fd530093ae0 legacy=0x7fd530091d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 -- 172.21.15.51:0/2994271510 shutdown_connections 2021-02-06T22:52:26.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 -- 172.21.15.51:0/2994271510 >> 172.21.15.51:0/2994271510 conn(0x7fd5300990c0 msgr2=0x7fd5300994d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:26.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 -- 172.21.15.51:0/2994271510 shutdown_connections 2021-02-06T22:52:26.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 -- 172.21.15.51:0/2994271510 wait complete. 2021-02-06T22:52:26.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 librados: starting msgr at 2021-02-06T22:52:26.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 librados: starting objecter 2021-02-06T22:52:26.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.419+0000 7fd535538700 1 Processor -- start 2021-02-06T22:52:26.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 -- start start 2021-02-06T22:52:26.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 librados: setting wanted keys 2021-02-06T22:52:26.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 librados: calling monclient init 2021-02-06T22:52:26.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300974b0 con 0x7fd530093ec0 2021-02-06T22:52:26.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530130970 con 0x7fd530093ae0 2021-02-06T22:52:26.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd535538700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530113fd0 con 0x7fd53012cd30 2021-02-06T22:52:26.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd534d37700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd53012cd30 0x7fd530141920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59854/0 (socket says 172.21.15.51:59854) 2021-02-06T22:52:26.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd52f7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 0x7fd530130260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59510/0 (socket says 172.21.15.51:59510) 2021-02-06T22:52:26.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.420+0000 7fd534d37700 1 -- 172.21.15.51:0/3691264174 learned_addr learned my addr 172.21.15.51:0/3691264174 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:26.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd52f7fe700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd517fff700 10 client.?.objecter ms_handle_connect 0x7fd530093ec0 2021-02-06T22:52:26.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd517fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd517fff700 10 client.?.objecter ms_handle_connect 0x7fd53012cd30 2021-02-06T22:52:26.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd517fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.422+0000 7fd534d37700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6790/0 conn(0x7fd53012cd30 legacy=0x7fd530141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692798488 0 0) 0x7fd5300974b0 con 0x7fd530093ec0 2021-02-06T22:52:26.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd510004bd0 con 0x7fd530093ec0 2021-02-06T22:52:26.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268003877 0 0) 0x7fd530113fd0 con 0x7fd53012cd30 2021-02-06T22:52:26.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5300974b0 con 0x7fd53012cd30 2021-02-06T22:52:26.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 10 client.?.objecter ms_handle_connect 0x7fd530093ae0 2021-02-06T22:52:26.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:26.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd52ffff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ae0 legacy=0x7fd53012fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2494425640 0 0) 0x7fd510004bd0 con 0x7fd530093ec0 2021-02-06T22:52:26.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd530113fd0 con 0x7fd530093ec0 2021-02-06T22:52:26.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd524001b60 con 0x7fd530093ec0 2021-02-06T22:52:26.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1706254264 0 0) 0x7fd5300974b0 con 0x7fd53012cd30 2021-02-06T22:52:26.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd510004bd0 con 0x7fd53012cd30 2021-02-06T22:52:26.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567052991 0 0) 0x7fd530130970 con 0x7fd530093ae0 2021-02-06T22:52:26.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5300974b0 con 0x7fd530093ae0 2021-02-06T22:52:26.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd528001d10 con 0x7fd53012cd30 2021-02-06T22:52:26.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1667252384 0 0) 0x7fd530113fd0 con 0x7fd530093ec0 2021-02-06T22:52:26.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6790/0 conn(0x7fd53012cd30 legacy=0x7fd530141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ae0 legacy=0x7fd53012fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530114270 con 0x7fd530093ec0 2021-02-06T22:52:26.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd52f7fe700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-06T22:52:26.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd52f7fe700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530130260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:52:26.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd52f7fe700 1 --1- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 0x7fd530130260 :-1 s=OPENED pgs=94 cs=1 l=1).handle_message read tag failed 2021-02-06T22:52:26.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd52f7fe700 1 --1- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 0x7fd530130260 :-1 s=OPENED pgs=94 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:52:26.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd530132a00 con 0x7fd530093ec0 2021-02-06T22:52:26.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd530093ec0 legacy=0x7fd530130260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:52:26.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd535538700 10 client.4290.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:26.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd530113fd0 con 0x7fd510005880 2021-02-06T22:52:26.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd530130970 con 0x7fd530093ae0 2021-02-06T22:52:26.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7fd510012f30 con 0x7fd53012cd30 2021-02-06T22:52:26.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.423+0000 7fd535538700 1 librados: init done 2021-02-06T22:52:26.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd517fff700 10 client.4290.objecter ms_handle_connect 0x7fd53012cd30 2021-02-06T22:52:26.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd517fff700 10 client.4290.objecter resend_mon_ops 2021-02-06T22:52:26.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd534d37700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6790/0 conn(0x7fd53012cd30 legacy=0x7fd51000f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd517fff700 10 client.4290.objecter ms_handle_connect 0x7fd510005880 2021-02-06T22:52:26.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd517fff700 10 client.4290.objecter resend_mon_ops 2021-02-06T22:52:26.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.425+0000 7fd52f7fe700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd510005880 legacy=0x7fd51000c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 10 client.4290.objecter ms_handle_connect 0x7fd530093ae0 2021-02-06T22:52:26.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd52ffff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ae0 legacy=0x7fd510005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:26.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 10 client.4290.objecter resend_mon_ops 2021-02-06T22:52:26.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817283613 0 0) 0x7fd510012f30 con 0x7fd53012cd30 2021-02-06T22:52:26.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5100130c0 con 0x7fd53012cd30 2021-02-06T22:52:26.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029573729 0 0) 0x7fd530113fd0 con 0x7fd510005880 2021-02-06T22:52:26.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd510012f30 con 0x7fd510005880 2021-02-06T22:52:26.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374450791 0 0) 0x7fd530130970 con 0x7fd530093ae0 2021-02-06T22:52:26.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd530113fd0 con 0x7fd530093ae0 2021-02-06T22:52:26.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3306539375 0 0) 0x7fd510012f30 con 0x7fd510005880 2021-02-06T22:52:26.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd530130970 con 0x7fd510005880 2021-02-06T22:52:26.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5240028e0 con 0x7fd510005880 2021-02-06T22:52:26.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2257328449 0 0) 0x7fd5100130c0 con 0x7fd53012cd30 2021-02-06T22:52:26.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd510012f30 con 0x7fd53012cd30 2021-02-06T22:52:26.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd528004ed0 con 0x7fd53012cd30 2021-02-06T22:52:26.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 78142809 0 0) 0x7fd530113fd0 con 0x7fd530093ae0 2021-02-06T22:52:26.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5100130c0 con 0x7fd530093ae0 2021-02-06T22:52:26.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5200016c0 con 0x7fd530093ae0 2021-02-06T22:52:26.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1317501021 0 0) 0x7fd530130970 con 0x7fd510005880 2021-02-06T22:52:26.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6790/0 conn(0x7fd53012cd30 legacy=0x7fd51000f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.106:6789/0 conn(0x7fd530093ae0 legacy=0x7fd510005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) v3 -- 0x7fd5100141f0 con 0x7fd510005880 2021-02-06T22:52:26.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd530132a00 con 0x7fd510005880 2021-02-06T22:52:26.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5300581b0 con 0x7fd510005880 2021-02-06T22:52:26.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510012f30 con 0x7fd510005880 2021-02-06T22:52:26.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.426+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd524002c50 con 0x7fd510005880 2021-02-06T22:52:26.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fd524005780 con 0x7fd510005880 2021-02-06T22:52:26.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 7 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fd524039aa0 con 0x7fd510005880 2021-02-06T22:52:26.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 10 client.4290.objecter ms_dispatch 0x7fd530001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:26.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 3 client.4290.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:26.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 3 client.4290.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:26.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.427+0000 7fd517fff700 20 client.4290.objecter dump_active .. 0 homeless 2021-02-06T22:52:26.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.430+0000 7fd517fff700 10 client.4290.objecter ms_handle_connect 0x7fd530093ec0 2021-02-06T22:52:26.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.430+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd524012820 con 0x7fd510005880 2021-02-06T22:52:26.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.434+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd524012640 con 0x7fd510005880 2021-02-06T22:52:26.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.611+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd530068b00 con 0x7fd510005880 2021-02-06T22:52:26.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.611+0000 7fd517fff700 1 -- 172.21.15.51:0/3691264174 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 3327677263) 0x7fd524012820 con 0x7fd510005880 2021-02-06T22:52:26.611 INFO:teuthology.orchestra.run.smithi051.stdout:47244640257 2021-02-06T22:52:26.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 10 librados: watch_flush enter 2021-02-06T22:52:26.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 10 librados: watch_flush exit 2021-02-06T22:52:26.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 20 client.4290.objecter shutdown clearing up homeless session... 2021-02-06T22:52:26.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 10 client.4290.objecter successfully canceled tick 2021-02-06T22:52:26.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.106:6812/33219 conn(0x7fd530093ec0 legacy=0x7fd51003ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 >> v1:172.21.15.51:6789/0 conn(0x7fd510005880 legacy=0x7fd51000c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:26.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 shutdown_connections 2021-02-06T22:52:26.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 >> 172.21.15.51:0/3691264174 conn(0x7fd5300990c0 msgr2=0x7fd530095b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:26.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 shutdown_connections 2021-02-06T22:52:26.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 -- 172.21.15.51:0/3691264174 wait complete. 2021-02-06T22:52:26.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:26.613+0000 7fd535538700 1 librados: shutdown 2021-02-06T22:52:26.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.4 2021-02-06T22:52:27.625 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2021-02-06T22:52:27.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a9645700 1 Processor -- start 2021-02-06T22:52:27.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a9645700 1 -- start start 2021-02-06T22:52:27.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a9645700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4095440 con 0x7f68a4092bf0 2021-02-06T22:52:27.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a9645700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a40907b0 con 0x7f68a412ce00 2021-02-06T22:52:27.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a9645700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4091010 con 0x7f68a408fa70 2021-02-06T22:52:27.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a2ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 0x7f68a40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59866/0 (socket says 172.21.15.51:59866) 2021-02-06T22:52:27.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a2ffd700 1 -- 172.21.15.51:0/1163661107 learned_addr learned my addr 172.21.15.51:0/1163661107 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:27.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.763+0000 7f68a27fc700 1 --1- 172.21.15.51:0/1163661107 >> v1:172.21.15.51:6789/0 conn(0x7f68a4092bf0 0x7f68a40930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59528/0 (socket says 172.21.15.51:59528) 2021-02-06T22:52:27.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a27fc700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.51:6789/0 conn(0x7f68a4092bf0 legacy=0x7f68a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a2ffd700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 legacy=0x7f68a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100468422 0 0) 0x7f68a4095440 con 0x7f68a4092bf0 2021-02-06T22:52:27.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6890003230 con 0x7f68a4092bf0 2021-02-06T22:52:27.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82049496 0 0) 0x7f68a4091010 con 0x7f68a408fa70 2021-02-06T22:52:27.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4095440 con 0x7f68a408fa70 2021-02-06T22:52:27.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a37fe700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.106:6789/0 conn(0x7f68a412ce00 legacy=0x7f68a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2516057541 0 0) 0x7f6890003230 con 0x7f68a4092bf0 2021-02-06T22:52:27.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 legacy=0x7f68a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.106:6789/0 conn(0x7f68a412ce00 legacy=0x7f68a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40912b0 con 0x7f68a4092bf0 2021-02-06T22:52:27.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f68980019f0 con 0x7f68a4092bf0 2021-02-06T22:52:27.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6898001c50 con 0x7f68a4092bf0 2021-02-06T22:52:27.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.766+0000 7f68a1ffb700 1 -- 172.21.15.51:0/1163661107 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6898004690 con 0x7f68a4092bf0 2021-02-06T22:52:27.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.767+0000 7f68a9645700 1 -- 172.21.15.51:0/1163661107 >> v1:172.21.15.51:6789/0 conn(0x7f68a4092bf0 legacy=0x7f68a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.767+0000 7f68a9645700 1 -- 172.21.15.51:0/1163661107 shutdown_connections 2021-02-06T22:52:27.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.767+0000 7f68a9645700 1 -- 172.21.15.51:0/1163661107 >> 172.21.15.51:0/1163661107 conn(0x7f68a4096860 msgr2=0x7f68a4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:27.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.767+0000 7f68a9645700 1 -- 172.21.15.51:0/1163661107 shutdown_connections 2021-02-06T22:52:27.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.767+0000 7f68a9645700 1 -- 172.21.15.51:0/1163661107 wait complete. 2021-02-06T22:52:27.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 librados: starting msgr at 2021-02-06T22:52:27.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 librados: starting objecter 2021-02-06T22:52:27.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 Processor -- start 2021-02-06T22:52:27.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 -- start start 2021-02-06T22:52:27.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 librados: setting wanted keys 2021-02-06T22:52:27.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 librados: calling monclient init 2021-02-06T22:52:27.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4129750 con 0x7f68a4092bf0 2021-02-06T22:52:27.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a41299f0 con 0x7f68a412ce00 2021-02-06T22:52:27.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a9645700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a4129c90 con 0x7f68a408fa70 2021-02-06T22:52:27.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a2ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 0x7f68a4135620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59874/0 (socket says 172.21.15.51:59874) 2021-02-06T22:52:27.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.768+0000 7f68a2ffd700 1 -- 172.21.15.51:0/315534292 learned_addr learned my addr 172.21.15.51:0/315534292 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:27.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a27fc700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.51:6789/0 conn(0x7f68a4092bf0 legacy=0x7f68a412b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter ms_handle_connect 0x7f68a4092bf0 2021-02-06T22:52:27.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:27.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a2ffd700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 legacy=0x7f68a4135620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter ms_handle_connect 0x7f68a408fa70 2021-02-06T22:52:27.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:27.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886309882 0 0) 0x7f68a4129750 con 0x7f68a4092bf0 2021-02-06T22:52:27.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6884004bd0 con 0x7f68a4092bf0 2021-02-06T22:52:27.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723488336 0 0) 0x7f68a4129c90 con 0x7f68a408fa70 2021-02-06T22:52:27.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4129750 con 0x7f68a408fa70 2021-02-06T22:52:27.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter ms_handle_connect 0x7f68a412ce00 2021-02-06T22:52:27.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:27.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a37fe700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.106:6789/0 conn(0x7f68a412ce00 legacy=0x7f68a413d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:27.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628490664 0 0) 0x7f68a41299f0 con 0x7f68a412ce00 2021-02-06T22:52:27.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a4129c90 con 0x7f68a412ce00 2021-02-06T22:52:27.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2841033286 0 0) 0x7f6884004bd0 con 0x7f68a4092bf0 2021-02-06T22:52:27.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68a41299f0 con 0x7f68a4092bf0 2021-02-06T22:52:27.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2029710282 0 0) 0x7f68a4129750 con 0x7f68a408fa70 2021-02-06T22:52:27.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6884004bd0 con 0x7f68a408fa70 2021-02-06T22:52:27.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6898004690 con 0x7f68a4092bf0 2021-02-06T22:52:27.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6894001ce0 con 0x7f68a408fa70 2021-02-06T22:52:27.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2821583278 0 0) 0x7f68a4129c90 con 0x7f68a412ce00 2021-02-06T22:52:27.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f68a4129750 con 0x7f68a412ce00 2021-02-06T22:52:27.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 108822041 0 0) 0x7f68a41299f0 con 0x7f68a4092bf0 2021-02-06T22:52:27.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.51:6790/0 conn(0x7f68a408fa70 legacy=0x7f68a4135620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.106:6789/0 conn(0x7f68a412ce00 legacy=0x7f68a413d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4127b90 con 0x7f68a4092bf0 2021-02-06T22:52:27.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f689c001e70 con 0x7f68a412ce00 2021-02-06T22:52:27.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a4135d90 con 0x7f68a4092bf0 2021-02-06T22:52:27.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a9645700 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:27.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a412ba10 con 0x7f68a4092bf0 2021-02-06T22:52:27.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f68a9645700 1 librados: init done 2021-02-06T22:52:27.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6898004e10 con 0x7f68a4092bf0 2021-02-06T22:52:27.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.771+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6898004f80 con 0x7f68a4092bf0 2021-02-06T22:52:27.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f689800d740 con 0x7f68a4092bf0 2021-02-06T22:52:27.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f68980395e0 con 0x7f68a4092bf0 2021-02-06T22:52:27.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 10 client.4296.objecter ms_dispatch 0x7f68a4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:27.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 3 client.4296.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:27.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 3 client.4296.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:27.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f688affd700 20 client.4296.objecter dump_active .. 0 homeless 2021-02-06T22:52:27.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.772+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c004d60 con 0x7f68a4092bf0 2021-02-06T22:52:27.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.775+0000 7f688affd700 10 client.4296.objecter ms_handle_connect 0x7f68840307a0 2021-02-06T22:52:27.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.777+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f6898012590 con 0x7f68a4092bf0 2021-02-06T22:52:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.956+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f687c005430 con 0x7f68a4092bf0 2021-02-06T22:52:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.957+0000 7f688affd700 1 -- 172.21.15.51:0/315534292 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7f6898012360 con 0x7f68a4092bf0 2021-02-06T22:52:27.957 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 10 librados: watch_flush enter 2021-02-06T22:52:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 10 librados: watch_flush exit 2021-02-06T22:52:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 20 client.4296.objecter shutdown clearing up homeless session... 2021-02-06T22:52:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 10 client.4296.objecter successfully canceled tick 2021-02-06T22:52:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.106:6812/33219 conn(0x7f68840307a0 legacy=0x7f6884032c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 >> v1:172.21.15.51:6789/0 conn(0x7f68a4092bf0 legacy=0x7f68a412b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 shutdown_connections 2021-02-06T22:52:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 >> 172.21.15.51:0/315534292 conn(0x7f68a4096860 msgr2=0x7f68a412c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 shutdown_connections 2021-02-06T22:52:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 -- 172.21.15.51:0/315534292 wait complete. 2021-02-06T22:52:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:27.958+0000 7f68a9645700 1 librados: shutdown 2021-02-06T22:52:27.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640259 for osd.4 2021-02-06T22:52:27.969 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2021-02-06T22:52:28.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.093+0000 7f42d5b01700 1 Processor -- start 2021-02-06T22:52:28.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.093+0000 7f42d5b01700 1 -- start start 2021-02-06T22:52:28.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.093+0000 7f42d5b01700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d0095440 con 0x7f42d012ce00 2021-02-06T22:52:28.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.093+0000 7f42d5b01700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d00907b0 con 0x7f42d008fa70 2021-02-06T22:52:28.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.093+0000 7f42d5b01700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d0091010 con 0x7f42d0092bf0 2021-02-06T22:52:28.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.094+0000 7f42cffff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f42d012ce00 0x7f42d012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59540/0 (socket says 172.21.15.51:59540) 2021-02-06T22:52:28.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.094+0000 7f42ceffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 0x7f42d00930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59884/0 (socket says 172.21.15.51:59884) 2021-02-06T22:52:28.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.094+0000 7f42cffff700 1 -- 172.21.15.51:0/979528695 learned_addr learned my addr 172.21.15.51:0/979528695 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42cffff700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.51:6789/0 conn(0x7f42d012ce00 legacy=0x7f42d012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ceffd700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 legacy=0x7f42d00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42cf7fe700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.106:6789/0 conn(0x7f42d008fa70 legacy=0x7f42d00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461453400 0 0) 0x7f42d0091010 con 0x7f42d0092bf0 2021-02-06T22:52:28.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42bc003230 con 0x7f42d0092bf0 2021-02-06T22:52:28.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010041249 0 0) 0x7f42d0095440 con 0x7f42d012ce00 2021-02-06T22:52:28.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d0091010 con 0x7f42d012ce00 2021-02-06T22:52:28.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491086877 0 0) 0x7f42d00907b0 con 0x7f42d008fa70 2021-02-06T22:52:28.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d0095440 con 0x7f42d008fa70 2021-02-06T22:52:28.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2968315430 0 0) 0x7f42bc003230 con 0x7f42d0092bf0 2021-02-06T22:52:28.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.106:6789/0 conn(0x7f42d008fa70 legacy=0x7f42d00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.51:6789/0 conn(0x7f42d012ce00 legacy=0x7f42d012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d00912b0 con 0x7f42d0092bf0 2021-02-06T22:52:28.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f42c4001930 con 0x7f42d0092bf0 2021-02-06T22:52:28.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f42c4001c40 con 0x7f42d0092bf0 2021-02-06T22:52:28.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.096+0000 7f42ce7fc700 1 -- 172.21.15.51:0/979528695 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f42c4004690 con 0x7f42d0092bf0 2021-02-06T22:52:28.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.097+0000 7f42d5b01700 1 -- 172.21.15.51:0/979528695 >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 legacy=0x7f42d00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.097+0000 7f42d5b01700 1 -- 172.21.15.51:0/979528695 shutdown_connections 2021-02-06T22:52:28.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.097+0000 7f42d5b01700 1 -- 172.21.15.51:0/979528695 >> 172.21.15.51:0/979528695 conn(0x7f42d0096860 msgr2=0x7f42d0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:28.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.097+0000 7f42d5b01700 1 -- 172.21.15.51:0/979528695 shutdown_connections 2021-02-06T22:52:28.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.097+0000 7f42d5b01700 1 -- 172.21.15.51:0/979528695 wait complete. 2021-02-06T22:52:28.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 librados: starting msgr at 2021-02-06T22:52:28.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 librados: starting objecter 2021-02-06T22:52:28.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 Processor -- start 2021-02-06T22:52:28.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 -- start start 2021-02-06T22:52:28.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 librados: setting wanted keys 2021-02-06T22:52:28.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 librados: calling monclient init 2021-02-06T22:52:28.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d00660f0 con 0x7f42d008fa70 2021-02-06T22:52:28.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d00657b0 con 0x7f42d012ce00 2021-02-06T22:52:28.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42d5b01700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d0090bf0 con 0x7f42d0092bf0 2021-02-06T22:52:28.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42cf7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f42d008fa70 0x7f42d0136700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59544/0 (socket says 172.21.15.51:59544) 2021-02-06T22:52:28.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42ceffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 0x7f42d013ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59888/0 (socket says 172.21.15.51:59888) 2021-02-06T22:52:28.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.098+0000 7f42cf7fe700 1 -- 172.21.15.51:0/3593910072 learned_addr learned my addr 172.21.15.51:0/3593910072 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42ceffd700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 legacy=0x7f42d013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42cf7fe700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.51:6789/0 conn(0x7f42d008fa70 legacy=0x7f42d0136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter ms_handle_connect 0x7f42d0092bf0 2021-02-06T22:52:28.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter ms_handle_connect 0x7f42d008fa70 2021-02-06T22:52:28.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371470532 0 0) 0x7f42d0090bf0 con 0x7f42d0092bf0 2021-02-06T22:52:28.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0004bd0 con 0x7f42d0092bf0 2021-02-06T22:52:28.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015067141 0 0) 0x7f42d00660f0 con 0x7f42d008fa70 2021-02-06T22:52:28.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d0090bf0 con 0x7f42d008fa70 2021-02-06T22:52:28.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42cffff700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.106:6789/0 conn(0x7f42d012ce00 legacy=0x7f42d0142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter ms_handle_connect 0x7f42d012ce00 2021-02-06T22:52:28.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.110 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958030185 0 0) 0x7f42d00657b0 con 0x7f42d012ce00 2021-02-06T22:52:28.110 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d00660f0 con 0x7f42d012ce00 2021-02-06T22:52:28.110 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1769753056 0 0) 0x7f42b0004bd0 con 0x7f42d0092bf0 2021-02-06T22:52:28.110 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42d00657b0 con 0x7f42d0092bf0 2021-02-06T22:52:28.110 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2763238439 0 0) 0x7f42d0090bf0 con 0x7f42d008fa70 2021-02-06T22:52:28.111 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42b0004bd0 con 0x7f42d008fa70 2021-02-06T22:52:28.111 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f42c40018f0 con 0x7f42d0092bf0 2021-02-06T22:52:28.111 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f42c0001c60 con 0x7f42d008fa70 2021-02-06T22:52:28.111 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2301391240 0 0) 0x7f42d00657b0 con 0x7f42d0092bf0 2021-02-06T22:52:28.112 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.106:6789/0 conn(0x7f42d012ce00 legacy=0x7f42d0142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.112 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.51:6789/0 conn(0x7f42d008fa70 legacy=0x7f42d0136700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.112 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d0123a90 con 0x7f42d0092bf0 2021-02-06T22:52:28.112 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d012c190 con 0x7f42d0092bf0 2021-02-06T22:52:28.112 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42d5b01700 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:28.113 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d0137050 con 0x7f42d0092bf0 2021-02-06T22:52:28.113 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42d5b01700 1 librados: init done 2021-02-06T22:52:28.113 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f42c4004d40 con 0x7f42d0092bf0 2021-02-06T22:52:28.113 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.101+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f42c4001560 con 0x7f42d0092bf0 2021-02-06T22:52:28.113 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f42c4005050 con 0x7f42d0092bf0 2021-02-06T22:52:28.114 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f42c4039620 con 0x7f42d0092bf0 2021-02-06T22:52:28.114 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 10 client.4289.objecter ms_dispatch 0x7f42d0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:28.114 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 3 client.4289.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:28.114 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 3 client.4289.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:28.114 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a8004d60 con 0x7f42d0092bf0 2021-02-06T22:52:28.115 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.102+0000 7f42b77fe700 20 client.4289.objecter dump_active .. 0 homeless 2021-02-06T22:52:28.115 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.105+0000 7f42b77fe700 10 client.4289.objecter ms_handle_connect 0x7f42b00306a0 2021-02-06T22:52:28.115 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.106+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f42c40125d0 con 0x7f42d0092bf0 2021-02-06T22:52:28.287 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.288+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f42a8005430 con 0x7f42d0092bf0 2021-02-06T22:52:28.287 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.288+0000 7f42b77fe700 1 -- 172.21.15.51:0/3593910072 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7f42c40121c0 con 0x7f42d0092bf0 2021-02-06T22:52:28.288 INFO:teuthology.orchestra.run.smithi051.stdout:47244640259 2021-02-06T22:52:28.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.289+0000 7f42d5b01700 10 librados: watch_flush enter 2021-02-06T22:52:28.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.289+0000 7f42d5b01700 10 librados: watch_flush exit 2021-02-06T22:52:28.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.289+0000 7f42d5b01700 20 client.4289.objecter shutdown clearing up homeless session... 2021-02-06T22:52:28.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.289+0000 7f42d5b01700 10 client.4289.objecter successfully canceled tick 2021-02-06T22:52:28.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.289+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.106:6812/33219 conn(0x7f42b00306a0 legacy=0x7f42b0032b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 >> v1:172.21.15.51:6790/0 conn(0x7f42d0092bf0 legacy=0x7f42d013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 shutdown_connections 2021-02-06T22:52:28.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 >> 172.21.15.51:0/3593910072 conn(0x7f42d0096860 msgr2=0x7f42d0122c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:28.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 shutdown_connections 2021-02-06T22:52:28.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 -- 172.21.15.51:0/3593910072 wait complete. 2021-02-06T22:52:28.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.290+0000 7f42d5b01700 1 librados: shutdown 2021-02-06T22:52:28.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2021-02-06T22:52:28.300 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2021-02-06T22:52:28.301 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-06T22:52:28.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe83237a700 1 Processor -- start 2021-02-06T22:52:28.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe83237a700 1 -- start start 2021-02-06T22:52:28.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe83237a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c095050 con 0x7fe82c0999a0 2021-02-06T22:52:28.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe83237a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c128c00 con 0x7fe82c067ec0 2021-02-06T22:52:28.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe83237a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c095280 con 0x7fe82c067a30 2021-02-06T22:52:28.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe82bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe82c0999a0 0x7fe82c1284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59556/0 (socket says 172.21.15.51:59556) 2021-02-06T22:52:28.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe82b7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe82c067a30 0x7fe82c12d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59894/0 (socket says 172.21.15.51:59894) 2021-02-06T22:52:28.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.424+0000 7fe82bfff700 1 -- 172.21.15.51:0/3195673244 learned_addr learned my addr 172.21.15.51:0/3195673244 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82bfff700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.51:6789/0 conn(0x7fe82c0999a0 legacy=0x7fe82c1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82b7fe700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.51:6790/0 conn(0x7fe82c067a30 legacy=0x7fe82c12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe830917700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.106:6789/0 conn(0x7fe82c067ec0 legacy=0x7fe82c130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693663416 0 0) 0x7fe82c095280 con 0x7fe82c067a30 2021-02-06T22:52:28.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003230 con 0x7fe82c067a30 2021-02-06T22:52:28.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511493078 0 0) 0x7fe82c095050 con 0x7fe82c0999a0 2021-02-06T22:52:28.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c095280 con 0x7fe82c0999a0 2021-02-06T22:52:28.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221469552 0 0) 0x7fe82c128c00 con 0x7fe82c067ec0 2021-02-06T22:52:28.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c095050 con 0x7fe82c067ec0 2021-02-06T22:52:28.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2729500315 0 0) 0x7fe82c095280 con 0x7fe82c0999a0 2021-02-06T22:52:28.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.51:6790/0 conn(0x7fe82c067a30 legacy=0x7fe82c12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.106:6789/0 conn(0x7fe82c067ec0 legacy=0x7fe82c130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c095520 con 0x7fe82c0999a0 2021-02-06T22:52:28.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe814001930 con 0x7fe82c0999a0 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe814001c40 con 0x7fe82c0999a0 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.427+0000 7fe82affd700 1 -- 172.21.15.51:0/3195673244 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe814004750 con 0x7fe82c0999a0 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 -- 172.21.15.51:0/3195673244 >> v1:172.21.15.51:6789/0 conn(0x7fe82c0999a0 legacy=0x7fe82c1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 -- 172.21.15.51:0/3195673244 shutdown_connections 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 -- 172.21.15.51:0/3195673244 >> 172.21.15.51:0/3195673244 conn(0x7fe82c096860 msgr2=0x7fe82c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:28.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 -- 172.21.15.51:0/3195673244 shutdown_connections 2021-02-06T22:52:28.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 -- 172.21.15.51:0/3195673244 wait complete. 2021-02-06T22:52:28.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 librados: starting msgr at 2021-02-06T22:52:28.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.428+0000 7fe83237a700 1 librados: starting objecter 2021-02-06T22:52:28.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 Processor -- start 2021-02-06T22:52:28.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 -- start start 2021-02-06T22:52:28.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 librados: setting wanted keys 2021-02-06T22:52:28.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 librados: calling monclient init 2021-02-06T22:52:28.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c067410 con 0x7fe82c0999a0 2021-02-06T22:52:28.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c0676b0 con 0x7fe82c067a30 2021-02-06T22:52:28.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe83237a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c090970 con 0x7fe82c067ec0 2021-02-06T22:52:28.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe82b7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe82c067ec0 0x7fe82c139980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59902/0 (socket says 172.21.15.51:59902) 2021-02-06T22:52:28.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.429+0000 7fe82b7fe700 1 -- 172.21.15.51:0/1779377471 learned_addr learned my addr 172.21.15.51:0/1779377471 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe82b7fe700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.51:6790/0 conn(0x7fe82c067ec0 legacy=0x7fe82c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe823fff700 10 client.?.objecter ms_handle_connect 0x7fe82c067ec0 2021-02-06T22:52:28.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe823fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe823fff700 10 client.?.objecter ms_handle_connect 0x7fe82c0999a0 2021-02-06T22:52:28.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe823fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.431+0000 7fe830917700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.51:6789/0 conn(0x7fe82c0999a0 legacy=0x7fe82c141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580647604 0 0) 0x7fe82c090970 con 0x7fe82c067ec0 2021-02-06T22:52:28.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe810004bd0 con 0x7fe82c067ec0 2021-02-06T22:52:28.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840684860 0 0) 0x7fe82c067410 con 0x7fe82c0999a0 2021-02-06T22:52:28.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c090970 con 0x7fe82c0999a0 2021-02-06T22:52:28.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 10 client.?.objecter ms_handle_connect 0x7fe82c067a30 2021-02-06T22:52:28.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe82bfff700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.106:6789/0 conn(0x7fe82c067a30 legacy=0x7fe82c091e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 878487693 0 0) 0x7fe810004bd0 con 0x7fe82c067ec0 2021-02-06T22:52:28.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe82c067410 con 0x7fe82c067ec0 2021-02-06T22:52:28.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe81c001ca0 con 0x7fe82c067ec0 2021-02-06T22:52:28.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2368583177 0 0) 0x7fe82c090970 con 0x7fe82c0999a0 2021-02-06T22:52:28.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe810004bd0 con 0x7fe82c0999a0 2021-02-06T22:52:28.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe824001fa0 con 0x7fe82c0999a0 2021-02-06T22:52:28.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539398163 0 0) 0x7fe82c0676b0 con 0x7fe82c067a30 2021-02-06T22:52:28.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe82c090970 con 0x7fe82c067a30 2021-02-06T22:52:28.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1926319391 0 0) 0x7fe82c067410 con 0x7fe82c067ec0 2021-02-06T22:52:28.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.106:6789/0 conn(0x7fe82c067a30 legacy=0x7fe82c091e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.51:6789/0 conn(0x7fe82c0999a0 legacy=0x7fe82c141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c092530 con 0x7fe82c067ec0 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c092780 con 0x7fe82c067ec0 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe83237a700 10 client.4295.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c13a250 con 0x7fe82c067ec0 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe83237a700 1 librados: init done 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe81c0049d0 con 0x7fe82c067ec0 2021-02-06T22:52:28.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.432+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe81c004ce0 con 0x7fe82c067ec0 2021-02-06T22:52:28.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fe81c004e70 con 0x7fe82c067ec0 2021-02-06T22:52:28.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fe81c0395a0 con 0x7fe82c067ec0 2021-02-06T22:52:28.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804004d60 con 0x7fe82c067ec0 2021-02-06T22:52:28.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 10 client.4295.objecter ms_dispatch 0x7fe82c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:28.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 3 client.4295.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:28.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 3 client.4295.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:28.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.433+0000 7fe823fff700 20 client.4295.objecter dump_active .. 0 homeless 2021-02-06T22:52:28.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.436+0000 7fe823fff700 10 client.4295.objecter ms_handle_connect 0x7fe8100306d0 2021-02-06T22:52:28.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.437+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fe81c012490 con 0x7fe82c067ec0 2021-02-06T22:52:28.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.615+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe804000b50 con 0x7fe8100306d0 2021-02-06T22:52:28.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.618+0000 7fe823fff700 1 -- 172.21.15.51:0/1779377471 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33417 (unknown 2965378022 0 1350753105) 0x7fe804000b50 con 0x7fe8100306d0 2021-02-06T22:52:28.617 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:28.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 10 librados: watch_flush enter 2021-02-06T22:52:28.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 10 librados: watch_flush exit 2021-02-06T22:52:28.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 20 client.4295.objecter shutdown clearing up homeless session... 2021-02-06T22:52:28.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 10 client.4295.objecter successfully canceled tick 2021-02-06T22:52:28.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.106:6812/33219 conn(0x7fe8100306d0 legacy=0x7fe810032b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 >> v1:172.21.15.51:6790/0 conn(0x7fe82c067ec0 legacy=0x7fe82c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 shutdown_connections 2021-02-06T22:52:28.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 >> 172.21.15.51:0/1779377471 conn(0x7fe82c096860 msgr2=0x7fe82c097e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:28.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 shutdown_connections 2021-02-06T22:52:28.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 -- 172.21.15.51:0/1779377471 wait complete. 2021-02-06T22:52:28.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.619+0000 7fe83237a700 1 librados: shutdown 2021-02-06T22:52:28.621 INFO:teuthology.orchestra.run.smithi051.stderr:dumped all 2021-02-06T22:52:28.630 INFO:teuthology.orchestra.run.smithi051.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2021-02-06T22:52:26.633963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29264,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":28480,"kb_avail":566201776,"statfs":{"total":579820584960,"available":579790618624,"internally_reserved":0,"allocated":753664,"data_stored":201182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29163520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.219402+0000","last_change":"2021-02-06T22:52:22.218463+0000","last_active":"2021-02-06T22:52:22.219402+0000","last_peered":"2021-02-06T22:52:22.219402+0000","last_clean":"2021-02-06T22:52:22.219402+0000","last_became_active":"2021-02-06T22:52:22.218086+0000","last_became_peered":"2021-02-06T22:52:22.218086+0000","last_unstale":"2021-02-06T22:52:22.219402+0000","last_undegraded":"2021-02-06T22:52:22.219402+0000","last_fullsized":"2021-02-06T22:52:22.219402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220742+0000","last_change":"2021-02-06T22:52:22.219017+0000","last_active":"2021-02-06T22:52:22.220742+0000","last_peered":"2021-02-06T22:52:22.220742+0000","last_clean":"2021-02-06T22:52:22.220742+0000","last_became_active":"2021-02-06T22:52:22.218649+0000","last_became_peered":"2021-02-06T22:52:22.218649+0000","last_unstale":"2021-02-06T22:52:22.220742+0000","last_undegraded":"2021-02-06T22:52:22.220742+0000","last_fullsized":"2021-02-06T22:52:22.220742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.217659+0000","last_change":"2021-02-06T22:52:22.217659+0000","last_active":"2021-02-06T22:52:22.217659+0000","last_peered":"2021-02-06T22:52:22.217659+0000","last_clean":"2021-02-06T22:52:22.217659+0000","last_became_active":"2021-02-06T22:52:22.217295+0000","last_became_peered":"2021-02-06T22:52:22.217295+0000","last_unstale":"2021-02-06T22:52:22.217659+0000","last_undegraded":"2021-02-06T22:52:22.217659+0000","last_fullsized":"2021-02-06T22:52:22.217659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.438893+0000","last_change":"2021-02-06T22:52:22.438354+0000","last_active":"2021-02-06T22:52:22.438893+0000","last_peered":"2021-02-06T22:52:22.438893+0000","last_clean":"2021-02-06T22:52:22.438893+0000","last_became_active":"2021-02-06T22:52:22.438107+0000","last_became_peered":"2021-02-06T22:52:22.438107+0000","last_unstale":"2021-02-06T22:52:22.438893+0000","last_undegraded":"2021-02-06T22:52:22.438893+0000","last_fullsized":"2021-02-06T22:52:22.438893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220454+0000","last_change":"2021-02-06T22:52:22.220454+0000","last_active":"2021-02-06T22:52:22.220454+0000","last_peered":"2021-02-06T22:52:22.220454+0000","last_clean":"2021-02-06T22:52:22.220454+0000","last_became_active":"2021-02-06T22:52:22.220155+0000","last_became_peered":"2021-02-06T22:52:22.220155+0000","last_unstale":"2021-02-06T22:52:22.220454+0000","last_undegraded":"2021-02-06T22:52:22.220454+0000","last_fullsized":"2021-02-06T22:52:22.220454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220681+0000","last_change":"2021-02-06T22:52:22.219481+0000","last_active":"2021-02-06T22:52:22.220681+0000","last_peered":"2021-02-06T22:52:22.220681+0000","last_clean":"2021-02-06T22:52:22.220681+0000","last_became_active":"2021-02-06T22:52:22.218937+0000","last_became_peered":"2021-02-06T22:52:22.218937+0000","last_unstale":"2021-02-06T22:52:22.220681+0000","last_undegraded":"2021-02-06T22:52:22.220681+0000","last_fullsized":"2021-02-06T22:52:22.220681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221493+0000","last_change":"2021-02-06T22:52:22.220288+0000","last_active":"2021-02-06T22:52:22.221493+0000","last_peered":"2021-02-06T22:52:22.221493+0000","last_clean":"2021-02-06T22:52:22.221493+0000","last_became_active":"2021-02-06T22:52:22.219962+0000","last_became_peered":"2021-02-06T22:52:22.219962+0000","last_unstale":"2021-02-06T22:52:22.221493+0000","last_undegraded":"2021-02-06T22:52:22.221493+0000","last_fullsized":"2021-02-06T22:52:22.221493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.218954+0000","last_change":"2021-02-06T22:52:22.218954+0000","last_active":"2021-02-06T22:52:22.218954+0000","last_peered":"2021-02-06T22:52:22.218954+0000","last_clean":"2021-02-06T22:52:22.218954+0000","last_became_active":"2021-02-06T22:52:22.218477+0000","last_became_peered":"2021-02-06T22:52:22.218477+0000","last_unstale":"2021-02-06T22:52:22.218954+0000","last_undegraded":"2021-02-06T22:52:22.218954+0000","last_fullsized":"2021-02-06T22:52:22.218954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.073}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]}]}} 2021-02-06T22:52:28.631 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-06T22:52:28.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.753+0000 7f474531c700 1 Processor -- start 2021-02-06T22:52:28.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f474531c700 1 -- start start 2021-02-06T22:52:28.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f474531c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740095440 con 0x7f4740092bf0 2021-02-06T22:52:28.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f474531c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400907b0 con 0x7f474008fa70 2021-02-06T22:52:28.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f474531c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740091010 con 0x7f474012ce00 2021-02-06T22:52:28.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f473f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 0x7f474012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59908/0 (socket says 172.21.15.51:59908) 2021-02-06T22:52:28.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f473f7fe700 1 -- 172.21.15.51:0/4273950101 learned_addr learned my addr 172.21.15.51:0/4273950101 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.754+0000 7f473e7fc700 1 --1- 172.21.15.51:0/4273950101 >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 0x7f47400930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59570/0 (socket says 172.21.15.51:59570) 2021-02-06T22:52:28.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.756+0000 7f473f7fe700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 legacy=0x7f474012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.756+0000 7f473e7fc700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 legacy=0x7f47400930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598858627 0 0) 0x7f4740091010 con 0x7f474012ce00 2021-02-06T22:52:28.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f472c003230 con 0x7f474012ce00 2021-02-06T22:52:28.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406867645 0 0) 0x7f4740095440 con 0x7f4740092bf0 2021-02-06T22:52:28.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740091010 con 0x7f4740092bf0 2021-02-06T22:52:28.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473effd700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.106:6789/0 conn(0x7f474008fa70 legacy=0x7f47400921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4277415270 0 0) 0x7f4740091010 con 0x7f4740092bf0 2021-02-06T22:52:28.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 legacy=0x7f474012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.106:6789/0 conn(0x7f474008fa70 legacy=0x7f47400921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400912b0 con 0x7f4740092bf0 2021-02-06T22:52:28.759 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4734001930 con 0x7f4740092bf0 2021-02-06T22:52:28.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4734001c40 con 0x7f4740092bf0 2021-02-06T22:52:28.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f473dffb700 1 -- 172.21.15.51:0/4273950101 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4734004690 con 0x7f4740092bf0 2021-02-06T22:52:28.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f474531c700 1 -- 172.21.15.51:0/4273950101 >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 legacy=0x7f47400930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f474531c700 1 -- 172.21.15.51:0/4273950101 shutdown_connections 2021-02-06T22:52:28.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f474531c700 1 -- 172.21.15.51:0/4273950101 >> 172.21.15.51:0/4273950101 conn(0x7f4740096860 msgr2=0x7f4740099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:28.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.757+0000 7f474531c700 1 -- 172.21.15.51:0/4273950101 shutdown_connections 2021-02-06T22:52:28.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 -- 172.21.15.51:0/4273950101 wait complete. 2021-02-06T22:52:28.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 librados: starting msgr at 2021-02-06T22:52:28.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 librados: starting objecter 2021-02-06T22:52:28.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 Processor -- start 2021-02-06T22:52:28.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 -- start start 2021-02-06T22:52:28.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 librados: setting wanted keys 2021-02-06T22:52:28.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.758+0000 7f474531c700 1 librados: calling monclient init 2021-02-06T22:52:28.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f474531c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740113ac0 con 0x7f4740092bf0 2021-02-06T22:52:28.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f474531c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740113d60 con 0x7f474008fa70 2021-02-06T22:52:28.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f474531c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740114000 con 0x7f474012ce00 2021-02-06T22:52:28.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f473f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 0x7f474013ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59918/0 (socket says 172.21.15.51:59918) 2021-02-06T22:52:28.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f473e7fc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 0x7f47401109f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59574/0 (socket says 172.21.15.51:59574) 2021-02-06T22:52:28.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.759+0000 7f473f7fe700 1 -- 172.21.15.51:0/2242694348 learned_addr learned my addr 172.21.15.51:0/2242694348 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:28.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f473e7fc700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 legacy=0x7f47401109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter ms_handle_connect 0x7f4740092bf0 2021-02-06T22:52:28.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f473f7fe700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 legacy=0x7f474013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter ms_handle_connect 0x7f474012ce00 2021-02-06T22:52:28.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128909991 0 0) 0x7f4740113ac0 con 0x7f4740092bf0 2021-02-06T22:52:28.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f473effd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6789/0 conn(0x7f474008fa70 legacy=0x7f47401102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:28.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4720004bd0 con 0x7f4740092bf0 2021-02-06T22:52:28.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter ms_handle_connect 0x7f474008fa70 2021-02-06T22:52:28.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:28.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150348475 0 0) 0x7f4740114000 con 0x7f474012ce00 2021-02-06T22:52:28.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740113ac0 con 0x7f474012ce00 2021-02-06T22:52:28.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836203902 0 0) 0x7f4740113d60 con 0x7f474008fa70 2021-02-06T22:52:28.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.761+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740114000 con 0x7f474008fa70 2021-02-06T22:52:28.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3996401952 0 0) 0x7f4720004bd0 con 0x7f4740092bf0 2021-02-06T22:52:28.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4740113d60 con 0x7f4740092bf0 2021-02-06T22:52:28.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f47340018f0 con 0x7f4740092bf0 2021-02-06T22:52:28.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2825030977 0 0) 0x7f4740113ac0 con 0x7f474012ce00 2021-02-06T22:52:28.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4720004bd0 con 0x7f474012ce00 2021-02-06T22:52:28.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4738001d10 con 0x7f474012ce00 2021-02-06T22:52:28.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3713539496 0 0) 0x7f4740114000 con 0x7f474008fa70 2021-02-06T22:52:28.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4740113ac0 con 0x7f474008fa70 2021-02-06T22:52:28.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4730001a60 con 0x7f474008fa70 2021-02-06T22:52:28.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1160273859 0 0) 0x7f4740113d60 con 0x7f4740092bf0 2021-02-06T22:52:28.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.51:6790/0 conn(0x7f474012ce00 legacy=0x7f474013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6789/0 conn(0x7f474008fa70 legacy=0x7f47401102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:28.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740111f00 con 0x7f4740092bf0 2021-02-06T22:52:28.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474012ca00 con 0x7f4740092bf0 2021-02-06T22:52:28.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f474531c700 10 client.4314.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:28.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f474012cbf0 con 0x7f4740092bf0 2021-02-06T22:52:28.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f474531c700 1 librados: init done 2021-02-06T22:52:28.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4734001560 con 0x7f4740092bf0 2021-02-06T22:52:28.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.762+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4734004e20 con 0x7f4740092bf0 2021-02-06T22:52:28.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4734004f80 con 0x7f4740092bf0 2021-02-06T22:52:28.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4718004d60 con 0x7f4740092bf0 2021-02-06T22:52:28.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f47340395f0 con 0x7f4740092bf0 2021-02-06T22:52:28.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 10 client.4314.objecter ms_dispatch 0x7f4740001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:28.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 3 client.4314.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:28.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 3 client.4314.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:28.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 20 client.4314.objecter dump_active .. 0 homeless 2021-02-06T22:52:28.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f473effd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 legacy=0x7f4720032e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2021-02-06T22:52:28.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f473effd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 legacy=0x7f4720032e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:52:28.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f473effd700 1 --1- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 0x7f4720032e20 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-06T22:52:28.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f473effd700 1 --1- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 0x7f4720032e20 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-06T22:52:28.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.763+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 legacy=0x7f4720032e20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:52:28.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:28.767+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4734012310 con 0x7f4740092bf0 2021-02-06T22:52:29.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.763+0000 7f47257fa700 1 -- 172.21.15.51:0/2242694348 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f471c006950 con 0x7f4720030960 2021-02-06T22:52:29.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.766+0000 7f4726ffd700 10 client.4314.objecter ms_handle_connect 0x7f4720030960 2021-02-06T22:52:29.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.768+0000 7f4726ffd700 1 -- 172.21.15.51:0/2242694348 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+33417 (unknown 2965378022 0 1763942449) 0x7f471c006950 con 0x7f4720030960 2021-02-06T22:52:29.768 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:29.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 10 librados: watch_flush enter 2021-02-06T22:52:29.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 10 librados: watch_flush exit 2021-02-06T22:52:29.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 20 client.4314.objecter shutdown clearing up homeless session... 2021-02-06T22:52:29.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 10 client.4314.objecter successfully canceled tick 2021-02-06T22:52:29.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.106:6812/33219 conn(0x7f4720030960 legacy=0x7f471c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 >> v1:172.21.15.51:6789/0 conn(0x7f4740092bf0 legacy=0x7f47401109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 shutdown_connections 2021-02-06T22:52:29.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 >> 172.21.15.51:0/2242694348 conn(0x7f4740096860 msgr2=0x7f47400970a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:29.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 shutdown_connections 2021-02-06T22:52:29.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 -- 172.21.15.51:0/2242694348 wait complete. 2021-02-06T22:52:29.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.771+0000 7f474531c700 1 librados: shutdown 2021-02-06T22:52:29.773 INFO:teuthology.orchestra.run.smithi051.stderr:dumped all 2021-02-06T22:52:29.785 INFO:teuthology.orchestra.run.smithi051.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-02-06T22:52:28.634445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29264,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":28480,"kb_avail":566201776,"statfs":{"total":579820584960,"available":579790618624,"internally_reserved":0,"allocated":753664,"data_stored":201182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29163520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.219402+0000","last_change":"2021-02-06T22:52:22.218463+0000","last_active":"2021-02-06T22:52:22.219402+0000","last_peered":"2021-02-06T22:52:22.219402+0000","last_clean":"2021-02-06T22:52:22.219402+0000","last_became_active":"2021-02-06T22:52:22.218086+0000","last_became_peered":"2021-02-06T22:52:22.218086+0000","last_unstale":"2021-02-06T22:52:22.219402+0000","last_undegraded":"2021-02-06T22:52:22.219402+0000","last_fullsized":"2021-02-06T22:52:22.219402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220742+0000","last_change":"2021-02-06T22:52:22.219017+0000","last_active":"2021-02-06T22:52:22.220742+0000","last_peered":"2021-02-06T22:52:22.220742+0000","last_clean":"2021-02-06T22:52:22.220742+0000","last_became_active":"2021-02-06T22:52:22.218649+0000","last_became_peered":"2021-02-06T22:52:22.218649+0000","last_unstale":"2021-02-06T22:52:22.220742+0000","last_undegraded":"2021-02-06T22:52:22.220742+0000","last_fullsized":"2021-02-06T22:52:22.220742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.217659+0000","last_change":"2021-02-06T22:52:22.217659+0000","last_active":"2021-02-06T22:52:22.217659+0000","last_peered":"2021-02-06T22:52:22.217659+0000","last_clean":"2021-02-06T22:52:22.217659+0000","last_became_active":"2021-02-06T22:52:22.217295+0000","last_became_peered":"2021-02-06T22:52:22.217295+0000","last_unstale":"2021-02-06T22:52:22.217659+0000","last_undegraded":"2021-02-06T22:52:22.217659+0000","last_fullsized":"2021-02-06T22:52:22.217659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.438893+0000","last_change":"2021-02-06T22:52:22.438354+0000","last_active":"2021-02-06T22:52:22.438893+0000","last_peered":"2021-02-06T22:52:22.438893+0000","last_clean":"2021-02-06T22:52:22.438893+0000","last_became_active":"2021-02-06T22:52:22.438107+0000","last_became_peered":"2021-02-06T22:52:22.438107+0000","last_unstale":"2021-02-06T22:52:22.438893+0000","last_undegraded":"2021-02-06T22:52:22.438893+0000","last_fullsized":"2021-02-06T22:52:22.438893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220454+0000","last_change":"2021-02-06T22:52:22.220454+0000","last_active":"2021-02-06T22:52:22.220454+0000","last_peered":"2021-02-06T22:52:22.220454+0000","last_clean":"2021-02-06T22:52:22.220454+0000","last_became_active":"2021-02-06T22:52:22.220155+0000","last_became_peered":"2021-02-06T22:52:22.220155+0000","last_unstale":"2021-02-06T22:52:22.220454+0000","last_undegraded":"2021-02-06T22:52:22.220454+0000","last_fullsized":"2021-02-06T22:52:22.220454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220681+0000","last_change":"2021-02-06T22:52:22.219481+0000","last_active":"2021-02-06T22:52:22.220681+0000","last_peered":"2021-02-06T22:52:22.220681+0000","last_clean":"2021-02-06T22:52:22.220681+0000","last_became_active":"2021-02-06T22:52:22.218937+0000","last_became_peered":"2021-02-06T22:52:22.218937+0000","last_unstale":"2021-02-06T22:52:22.220681+0000","last_undegraded":"2021-02-06T22:52:22.220681+0000","last_fullsized":"2021-02-06T22:52:22.220681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221493+0000","last_change":"2021-02-06T22:52:22.220288+0000","last_active":"2021-02-06T22:52:22.221493+0000","last_peered":"2021-02-06T22:52:22.221493+0000","last_clean":"2021-02-06T22:52:22.221493+0000","last_became_active":"2021-02-06T22:52:22.219962+0000","last_became_peered":"2021-02-06T22:52:22.219962+0000","last_unstale":"2021-02-06T22:52:22.221493+0000","last_undegraded":"2021-02-06T22:52:22.221493+0000","last_fullsized":"2021-02-06T22:52:22.221493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.218954+0000","last_change":"2021-02-06T22:52:22.218954+0000","last_active":"2021-02-06T22:52:22.218954+0000","last_peered":"2021-02-06T22:52:22.218954+0000","last_clean":"2021-02-06T22:52:22.218954+0000","last_became_active":"2021-02-06T22:52:22.218477+0000","last_became_peered":"2021-02-06T22:52:22.218477+0000","last_unstale":"2021-02-06T22:52:22.218954+0000","last_undegraded":"2021-02-06T22:52:22.218954+0000","last_fullsized":"2021-02-06T22:52:22.218954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2470000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4864,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366976,"statfs":{"total":96636764160,"available":96631783424,"internally_reserved":0,"allocated":122880,"data_stored":32304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9910000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.073}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]}]}]}} 2021-02-06T22:52:29.786 INFO:tasks.ceph.ceph_manager.ceph:clean! 2021-02-06T22:52:29.787 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-02-06T22:52:29.787 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2021-02-06T22:52:29.787 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:29.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.920+0000 7f4e7e55c700 1 Processor -- start 2021-02-06T22:52:29.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e7e55c700 1 -- start start 2021-02-06T22:52:29.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e7e55c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780915d0 con 0x7f4e780999a0 2021-02-06T22:52:29.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e7e55c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78091ac0 con 0x7f4e780928d0 2021-02-06T22:52:29.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e7e55c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78091d60 con 0x7f4e780629e0 2021-02-06T22:52:29.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e77fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4e780999a0 0x7f4e780907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59582/0 (socket says 172.21.15.51:59582) 2021-02-06T22:52:29.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e777fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 0x7f4e78090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59924/0 (socket says 172.21.15.51:59924) 2021-02-06T22:52:29.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.921+0000 7f4e77fff700 1 -- 172.21.15.51:0/4089587788 learned_addr learned my addr 172.21.15.51:0/4089587788 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:29.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.923+0000 7f4e777fe700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 legacy=0x7f4e78090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.923+0000 7f4e77fff700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.51:6789/0 conn(0x7f4e780999a0 legacy=0x7f4e780907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956161795 0 0) 0x7f4e78091d60 con 0x7f4e780629e0 2021-02-06T22:52:29.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e64003230 con 0x7f4e780629e0 2021-02-06T22:52:29.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437484877 0 0) 0x7f4e780915d0 con 0x7f4e780999a0 2021-02-06T22:52:29.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78091d60 con 0x7f4e780999a0 2021-02-06T22:52:29.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e7caf9700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.106:6789/0 conn(0x7f4e780928d0 legacy=0x7f4e7812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1213212998 0 0) 0x7f4e64003230 con 0x7f4e780629e0 2021-02-06T22:52:29.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.106:6789/0 conn(0x7f4e780928d0 legacy=0x7f4e7812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.51:6789/0 conn(0x7f4e780999a0 legacy=0x7f4e780907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78092000 con 0x7f4e780629e0 2021-02-06T22:52:29.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e68001930 con 0x7f4e780629e0 2021-02-06T22:52:29.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e777fe700 1 --1- 172.21.15.51:0/4089587788 >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 0x7f4e78090ec0 :-1 s=OPENED pgs=100 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f4e68004690 mon_map magic: 0 v1 2021-02-06T22:52:29.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e68001c40 con 0x7f4e780629e0 2021-02-06T22:52:29.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e7e55c700 1 -- 172.21.15.51:0/4089587788 >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 legacy=0x7f4e78090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e76ffd700 1 -- 172.21.15.51:0/4089587788 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e68004690 con 0x7f4e780629e0 2021-02-06T22:52:29.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e7e55c700 1 -- 172.21.15.51:0/4089587788 shutdown_connections 2021-02-06T22:52:29.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.924+0000 7f4e7e55c700 1 -- 172.21.15.51:0/4089587788 >> 172.21.15.51:0/4089587788 conn(0x7f4e78096860 msgr2=0x7f4e78099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:29.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.925+0000 7f4e7e55c700 1 -- 172.21.15.51:0/4089587788 shutdown_connections 2021-02-06T22:52:29.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.925+0000 7f4e7e55c700 1 -- 172.21.15.51:0/4089587788 wait complete. 2021-02-06T22:52:29.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.925+0000 7f4e7e55c700 1 librados: starting msgr at 2021-02-06T22:52:29.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.925+0000 7f4e7e55c700 1 librados: starting objecter 2021-02-06T22:52:29.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.925+0000 7f4e7e55c700 1 Processor -- start 2021-02-06T22:52:29.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 -- start start 2021-02-06T22:52:29.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 librados: setting wanted keys 2021-02-06T22:52:29.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 librados: calling monclient init 2021-02-06T22:52:29.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e78067330 con 0x7f4e780928d0 2021-02-06T22:52:29.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7812f830 con 0x7f4e780999a0 2021-02-06T22:52:29.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e7e55c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7812fad0 con 0x7f4e780629e0 2021-02-06T22:52:29.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e77fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 0x7f4e781303d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59930/0 (socket says 172.21.15.51:59930) 2021-02-06T22:52:29.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.926+0000 7f4e77fff700 1 -- 172.21.15.51:0/374074381 learned_addr learned my addr 172.21.15.51:0/374074381 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:29.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e77fff700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 legacy=0x7f4e781303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 10 client.?.objecter ms_handle_connect 0x7f4e780629e0 2021-02-06T22:52:29.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e777fe700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.51:6789/0 conn(0x7f4e780928d0 legacy=0x7f4e7812c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:29.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 10 client.?.objecter ms_handle_connect 0x7f4e780928d0 2021-02-06T22:52:29.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:29.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822057438 0 0) 0x7f4e7812fad0 con 0x7f4e780629e0 2021-02-06T22:52:29.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e58004bd0 con 0x7f4e780629e0 2021-02-06T22:52:29.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.928+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687837497 0 0) 0x7f4e78067330 con 0x7f4e780928d0 2021-02-06T22:52:29.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7812fad0 con 0x7f4e780928d0 2021-02-06T22:52:29.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 10 client.?.objecter ms_handle_connect 0x7f4e780999a0 2021-02-06T22:52:29.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:29.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e7caf9700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.106:6789/0 conn(0x7f4e780999a0 legacy=0x7f4e7812c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:29.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 883266029 0 0) 0x7f4e58004bd0 con 0x7f4e780629e0 2021-02-06T22:52:29.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e78067330 con 0x7f4e780629e0 2021-02-06T22:52:29.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e6c001990 con 0x7f4e780629e0 2021-02-06T22:52:29.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4188847679 0 0) 0x7f4e7812fad0 con 0x7f4e780928d0 2021-02-06T22:52:29.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e58004bd0 con 0x7f4e780928d0 2021-02-06T22:52:29.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830066548 0 0) 0x7f4e7812f830 con 0x7f4e780999a0 2021-02-06T22:52:29.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7812fad0 con 0x7f4e780999a0 2021-02-06T22:52:29.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e68004690 con 0x7f4e780928d0 2021-02-06T22:52:29.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 569605285 0 0) 0x7f4e78067330 con 0x7f4e780629e0 2021-02-06T22:52:29.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.106:6789/0 conn(0x7f4e780999a0 legacy=0x7f4e7812c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.51:6789/0 conn(0x7f4e780928d0 legacy=0x7f4e7812c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:29.939 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78130ae0 con 0x7f4e780629e0 2021-02-06T22:52:29.940 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7812ce50 con 0x7f4e780629e0 2021-02-06T22:52:29.940 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e7e55c700 10 client.4307.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:29.940 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7813fb70 con 0x7f4e780629e0 2021-02-06T22:52:29.940 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e7e55c700 1 librados: init done 2021-02-06T22:52:29.940 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e6c004920 con 0x7f4e780629e0 2021-02-06T22:52:29.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.929+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e6c004c30 con 0x7f4e780629e0 2021-02-06T22:52:29.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4e6c004e10 con 0x7f4e780629e0 2021-02-06T22:52:29.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f4e6c0395b0 con 0x7f4e780629e0 2021-02-06T22:52:29.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 10 client.4307.objecter ms_dispatch 0x7f4e78001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:29.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 3 client.4307.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:29.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 3 client.4307.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:29.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e5ffff700 20 client.4307.objecter dump_active .. 0 homeless 2021-02-06T22:52:29.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.930+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e50004d60 con 0x7f4e780629e0 2021-02-06T22:52:29.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.932+0000 7f4e5ffff700 10 client.4307.objecter ms_handle_connect 0x7f4e58030820 2021-02-06T22:52:29.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:29.934+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4e6c0124a0 con 0x7f4e780629e0 2021-02-06T22:52:30.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.188+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e500059b0 con 0x7f4e780629e0 2021-02-06T22:52:30.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.189+0000 7f4e5ffff700 1 -- 172.21.15.51:0/374074381 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f4e6c012090 con 0x7f4e780629e0 2021-02-06T22:52:30.188 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:30.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 10 librados: watch_flush enter 2021-02-06T22:52:30.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 10 librados: watch_flush exit 2021-02-06T22:52:30.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 20 client.4307.objecter shutdown clearing up homeless session... 2021-02-06T22:52:30.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 10 client.4307.objecter successfully canceled tick 2021-02-06T22:52:30.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.106:6812/33219 conn(0x7f4e58030820 legacy=0x7f4e58032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:30.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 >> v1:172.21.15.51:6790/0 conn(0x7f4e780629e0 legacy=0x7f4e781303d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:30.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 shutdown_connections 2021-02-06T22:52:30.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.190+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 >> 172.21.15.51:0/374074381 conn(0x7f4e78096860 msgr2=0x7f4e78129e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:30.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.191+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 shutdown_connections 2021-02-06T22:52:30.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.191+0000 7f4e7e55c700 1 -- 172.21.15.51:0/374074381 wait complete. 2021-02-06T22:52:30.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:30.191+0000 7f4e7e55c700 1 librados: shutdown 2021-02-06T22:52:30.201 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:33.202 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:33.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.338+0000 7f8160188700 1 Processor -- start 2021-02-06T22:52:33.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.338+0000 7f8160188700 1 -- start start 2021-02-06T22:52:33.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.339+0000 7f8160188700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580998a0 con 0x7f8158093e80 2021-02-06T22:52:33.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.339+0000 7f8160188700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158099b10 con 0x7f81580976b0 2021-02-06T22:52:33.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.339+0000 7f8160188700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158099db0 con 0x7f8158097200 2021-02-06T22:52:33.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.339+0000 7f815d723700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 0x7f815812fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59942/0 (socket says 172.21.15.51:59942) 2021-02-06T22:52:33.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.339+0000 7f815d723700 1 -- 172.21.15.51:0/1892367383 learned_addr learned my addr 172.21.15.51:0/1892367383 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:33.341 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.341+0000 7f815d723700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 legacy=0x7f815812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.341+0000 7f815df24700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.51:6789/0 conn(0x7f8158093e80 legacy=0x7f81581278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.341+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195205578 0 0) 0x7f8158099db0 con 0x7f8158097200 2021-02-06T22:52:33.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.341+0000 7f815e725700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.106:6789/0 conn(0x7f81580976b0 legacy=0x7f81581331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.341+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8140003230 con 0x7f8158097200 2021-02-06T22:52:33.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740897791 0 0) 0x7f81580998a0 con 0x7f8158093e80 2021-02-06T22:52:33.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8158099db0 con 0x7f8158093e80 2021-02-06T22:52:33.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2841228105 0 0) 0x7f8140003230 con 0x7f8158097200 2021-02-06T22:52:33.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.106:6789/0 conn(0x7f81580976b0 legacy=0x7f81581331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.51:6789/0 conn(0x7f8158093e80 legacy=0x7f81581278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8158127480 con 0x7f8158097200 2021-02-06T22:52:33.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8154001970 con 0x7f8158097200 2021-02-06T22:52:33.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3657345799 0 0) 0x7f8158099db0 con 0x7f8158093e80 2021-02-06T22:52:33.345 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8148001980 con 0x7f8158093e80 2021-02-06T22:52:33.345 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8154001c80 con 0x7f8158097200 2021-02-06T22:52:33.345 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f815cf22700 1 -- 172.21.15.51:0/1892367383 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8154004750 con 0x7f8158097200 2021-02-06T22:52:33.345 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f8160188700 1 -- 172.21.15.51:0/1892367383 >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 legacy=0x7f815812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.345 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f8160188700 1 -- 172.21.15.51:0/1892367383 shutdown_connections 2021-02-06T22:52:33.346 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f8160188700 1 -- 172.21.15.51:0/1892367383 >> 172.21.15.51:0/1892367383 conn(0x7f815809ae00 msgr2=0x7f815809d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:33.346 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f8160188700 1 -- 172.21.15.51:0/1892367383 shutdown_connections 2021-02-06T22:52:33.346 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.342+0000 7f8160188700 1 -- 172.21.15.51:0/1892367383 wait complete. 2021-02-06T22:52:33.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 librados: starting msgr at 2021-02-06T22:52:33.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 librados: starting objecter 2021-02-06T22:52:33.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 Processor -- start 2021-02-06T22:52:33.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 -- start start 2021-02-06T22:52:33.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 librados: setting wanted keys 2021-02-06T22:52:33.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.343+0000 7f8160188700 1 librados: calling monclient init 2021-02-06T22:52:33.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.344+0000 7f8160188700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81580995a0 con 0x7f81580976b0 2021-02-06T22:52:33.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.344+0000 7f8160188700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158122d00 con 0x7f8158093e80 2021-02-06T22:52:33.352 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.344+0000 7f8160188700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158122fa0 con 0x7f8158097200 2021-02-06T22:52:33.352 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.344+0000 7f815d723700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 0x7f8158124450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59946/0 (socket says 172.21.15.51:59946) 2021-02-06T22:52:33.352 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.344+0000 7f815d723700 1 -- 172.21.15.51:0/1737329329 learned_addr learned my addr 172.21.15.51:0/1737329329 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:33.352 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f815d723700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 legacy=0x7f8158124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f815e725700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.51:6789/0 conn(0x7f81580976b0 legacy=0x7f8158141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter ms_handle_connect 0x7f8158097200 2021-02-06T22:52:33.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:33.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter ms_handle_connect 0x7f81580976b0 2021-02-06T22:52:33.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:33.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038546069 0 0) 0x7f8158122fa0 con 0x7f8158097200 2021-02-06T22:52:33.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f815e725700 1 --1- 172.21.15.51:0/1737329329 >> v1:172.21.15.51:6789/0 conn(0x7f81580976b0 0x7f8158141e70 :-1 s=OPENED pgs=108 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f81580995a0 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:52:33.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8138004bd0 con 0x7f8158097200 2021-02-06T22:52:33.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter ms_handle_connect 0x7f8158093e80 2021-02-06T22:52:33.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:33.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f815df24700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.106:6789/0 conn(0x7f8158093e80 legacy=0x7f8158139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:33.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949182723 0 0) 0x7f8158122d00 con 0x7f8158093e80 2021-02-06T22:52:33.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8158122fa0 con 0x7f8158093e80 2021-02-06T22:52:33.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.346+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 457885496 0 0) 0x7f8138004bd0 con 0x7f8158097200 2021-02-06T22:52:33.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8158122d00 con 0x7f8158097200 2021-02-06T22:52:33.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8154001930 con 0x7f8158097200 2021-02-06T22:52:33.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3409617189 0 0) 0x7f8158122fa0 con 0x7f8158093e80 2021-02-06T22:52:33.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8138004bd0 con 0x7f8158093e80 2021-02-06T22:52:33.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f81480018e0 con 0x7f8158093e80 2021-02-06T22:52:33.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4197887923 0 0) 0x7f8158122d00 con 0x7f8158097200 2021-02-06T22:52:33.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.106:6789/0 conn(0x7f8158093e80 legacy=0x7f8158139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.51:6789/0 conn(0x7f81580976b0 legacy=0x7f8158141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815813a970 con 0x7f8158097200 2021-02-06T22:52:33.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312745109 0 0) 0x7f81580995a0 con 0x7f81580976b0 2021-02-06T22:52:33.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8158120e30 con 0x7f8158097200 2021-02-06T22:52:33.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8154004d40 con 0x7f8158097200 2021-02-06T22:52:33.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8154005050 con 0x7f8158097200 2021-02-06T22:52:33.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8160188700 10 client.4313.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:33.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158124b60 con 0x7f8158097200 2021-02-06T22:52:33.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.347+0000 7f8160188700 1 librados: init done 2021-02-06T22:52:33.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f815400d810 con 0x7f8158097200 2021-02-06T22:52:33.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f81540395b0 con 0x7f8158097200 2021-02-06T22:52:33.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 10 client.4313.objecter ms_dispatch 0x7f8158001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:33.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 3 client.4313.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:33.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 3 client.4313.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:33.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8145ffb700 20 client.4313.objecter dump_active .. 0 homeless 2021-02-06T22:52:33.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.348+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815805cbd0 con 0x7f8158097200 2021-02-06T22:52:33.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.351+0000 7f8145ffb700 10 client.4313.objecter ms_handle_connect 0x7f81380304c0 2021-02-06T22:52:33.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.352+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f8154012560 con 0x7f8158097200 2021-02-06T22:52:33.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.603+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81580581b0 con 0x7f8158097200 2021-02-06T22:52:33.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.603+0000 7f8145ffb700 1 -- 172.21.15.51:0/1737329329 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f8154012150 con 0x7f8158097200 2021-02-06T22:52:33.603 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:33.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 10 librados: watch_flush enter 2021-02-06T22:52:33.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 10 librados: watch_flush exit 2021-02-06T22:52:33.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 20 client.4313.objecter shutdown clearing up homeless session... 2021-02-06T22:52:33.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 10 client.4313.objecter successfully canceled tick 2021-02-06T22:52:33.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.106:6812/33219 conn(0x7f81380304c0 legacy=0x7f8138032980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 >> v1:172.21.15.51:6790/0 conn(0x7f8158097200 legacy=0x7f8158124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:33.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 shutdown_connections 2021-02-06T22:52:33.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 >> 172.21.15.51:0/1737329329 conn(0x7f815809ae00 msgr2=0x7f81580951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:33.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 shutdown_connections 2021-02-06T22:52:33.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 -- 172.21.15.51:0/1737329329 wait complete. 2021-02-06T22:52:33.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:33.605+0000 7f8160188700 1 librados: shutdown 2021-02-06T22:52:33.616 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:36.617 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:36.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.753+0000 7f0fb1bf0700 1 Processor -- start 2021-02-06T22:52:36.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.753+0000 7f0fb1bf0700 1 -- start start 2021-02-06T22:52:36.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac095440 con 0x7f0fac092bf0 2021-02-06T22:52:36.754 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac0907b0 con 0x7f0fac12ce00 2021-02-06T22:52:36.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac091010 con 0x7f0fac08fa70 2021-02-06T22:52:36.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0faaffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 0x7f0fac0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59612/0 (socket says 172.21.15.51:59612) 2021-02-06T22:52:36.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0fab7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 0x7f0fac0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59954/0 (socket says 172.21.15.51:59954) 2021-02-06T22:52:36.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.754+0000 7f0faaffd700 1 -- 172.21.15.51:0/3116460207 learned_addr learned my addr 172.21.15.51:0/3116460207 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:36.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faaffd700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 legacy=0x7f0fac0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:36.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0fab7fe700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 legacy=0x7f0fac0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:36.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227046521 0 0) 0x7f0fac095440 con 0x7f0fac092bf0 2021-02-06T22:52:36.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f98003230 con 0x7f0fac092bf0 2021-02-06T22:52:36.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815833561 0 0) 0x7f0fac091010 con 0x7f0fac08fa70 2021-02-06T22:52:36.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0fabfff700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 legacy=0x7f0fac12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:36.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac095440 con 0x7f0fac08fa70 2021-02-06T22:52:36.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899654907 0 0) 0x7f0fac0907b0 con 0x7f0fac12ce00 2021-02-06T22:52:36.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac091010 con 0x7f0fac12ce00 2021-02-06T22:52:36.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 543392995 0 0) 0x7f0f98003230 con 0x7f0fac092bf0 2021-02-06T22:52:36.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 legacy=0x7f0fac0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:36.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 legacy=0x7f0fac12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:36.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac0912b0 con 0x7f0fac092bf0 2021-02-06T22:52:36.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.756+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fa0001930 con 0x7f0fac092bf0 2021-02-06T22:52:36.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0fa0001c40 con 0x7f0fac092bf0 2021-02-06T22:52:36.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0faa7fc700 1 -- 172.21.15.51:0/3116460207 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fa0004750 con 0x7f0fac092bf0 2021-02-06T22:52:36.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/3116460207 >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 legacy=0x7f0fac0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:36.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/3116460207 shutdown_connections 2021-02-06T22:52:36.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/3116460207 >> 172.21.15.51:0/3116460207 conn(0x7f0fac096860 msgr2=0x7f0fac099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:36.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/3116460207 shutdown_connections 2021-02-06T22:52:36.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.757+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/3116460207 wait complete. 2021-02-06T22:52:36.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 librados: starting msgr at 2021-02-06T22:52:36.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 librados: starting objecter 2021-02-06T22:52:36.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 Processor -- start 2021-02-06T22:52:36.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 -- start start 2021-02-06T22:52:36.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 librados: setting wanted keys 2021-02-06T22:52:36.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 librados: calling monclient init 2021-02-06T22:52:36.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac123b30 con 0x7f0fac092bf0 2021-02-06T22:52:36.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac090bf0 con 0x7f0fac12ce00 2021-02-06T22:52:36.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.758+0000 7f0fb1bf0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fac12cbe0 con 0x7f0fac08fa70 2021-02-06T22:52:36.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0faaffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 0x7f0fac13ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59622/0 (socket says 172.21.15.51:59622) 2021-02-06T22:52:36.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0faaffd700 1 -- 172.21.15.51:0/996585394 learned_addr learned my addr 172.21.15.51:0/996585394 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:36.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0fab7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 0x7f0fac12c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59960/0 (socket says 172.21.15.51:59960) 2021-02-06T22:52:36.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0fabfff700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 legacy=0x7f0fac1423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-06T22:52:36.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0fabfff700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 legacy=0x7f0fac1423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:52:36.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0fabfff700 1 --1- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 0x7f0fac1423e0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-06T22:52:36.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.759+0000 7f0fabfff700 1 --1- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 0x7f0fac1423e0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-06T22:52:36.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0fab7fe700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 legacy=0x7f0fac12c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:36.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 10 client.?.objecter ms_handle_connect 0x7f0fac08fa70 2021-02-06T22:52:36.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:36.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 10 client.?.objecter ms_handle_connect 0x7f0fac092bf0 2021-02-06T22:52:36.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:36.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0faaffd700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 legacy=0x7f0fac13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:36.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655104352 0 0) 0x7f0fac123b30 con 0x7f0fac092bf0 2021-02-06T22:52:36.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c004bd0 con 0x7f0fac092bf0 2021-02-06T22:52:36.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978047756 0 0) 0x7f0fac12cbe0 con 0x7f0fac08fa70 2021-02-06T22:52:36.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac123b30 con 0x7f0fac08fa70 2021-02-06T22:52:36.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 350083615 0 0) 0x7f0fac123b30 con 0x7f0fac08fa70 2021-02-06T22:52:36.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fac12cbe0 con 0x7f0fac08fa70 2021-02-06T22:52:36.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1671047711 0 0) 0x7f0f8c004bd0 con 0x7f0fac092bf0 2021-02-06T22:52:36.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fac123b30 con 0x7f0fac092bf0 2021-02-06T22:52:36.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0f9c001c60 con 0x7f0fac08fa70 2021-02-06T22:52:36.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fa00018f0 con 0x7f0fac092bf0 2021-02-06T22:52:36.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2198758857 0 0) 0x7f0fac12cbe0 con 0x7f0fac08fa70 2021-02-06T22:52:36.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6789/0 conn(0x7f0fac12ce00 legacy=0x7f0fac1423e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:52:36.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.51:6789/0 conn(0x7f0fac092bf0 legacy=0x7f0fac13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:36.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac128da0 con 0x7f0fac08fa70 2021-02-06T22:52:36.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.761+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac066410 con 0x7f0fac08fa70 2021-02-06T22:52:36.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0fb1bf0700 10 client.4319.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:36.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac1365e0 con 0x7f0fac08fa70 2021-02-06T22:52:36.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0fb1bf0700 1 librados: init done 2021-02-06T22:52:36.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0f9c0048e0 con 0x7f0fac08fa70 2021-02-06T22:52:36.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0f9c004bf0 con 0x7f0fac08fa70 2021-02-06T22:52:36.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0f9c00d430 con 0x7f0fac08fa70 2021-02-06T22:52:36.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0f9c039470 con 0x7f0fac08fa70 2021-02-06T22:52:36.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 10 client.4319.objecter ms_dispatch 0x7f0fac001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:36.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 3 client.4319.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:36.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 3 client.4319.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:36.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0f937fe700 20 client.4319.objecter dump_active .. 0 homeless 2021-02-06T22:52:36.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.762+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f84004d60 con 0x7f0fac08fa70 2021-02-06T22:52:36.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.765+0000 7f0f937fe700 10 client.4319.objecter ms_handle_connect 0x7f0f8c030510 2021-02-06T22:52:36.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:36.767+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0f9c012360 con 0x7f0fac08fa70 2021-02-06T22:52:37.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.014+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0f840059b0 con 0x7f0fac08fa70 2021-02-06T22:52:37.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.014+0000 7f0f937fe700 1 -- 172.21.15.51:0/996585394 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0f9c011f50 con 0x7f0fac08fa70 2021-02-06T22:52:37.014 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:37.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 10 librados: watch_flush enter 2021-02-06T22:52:37.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 10 librados: watch_flush exit 2021-02-06T22:52:37.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 20 client.4319.objecter shutdown clearing up homeless session... 2021-02-06T22:52:37.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 10 client.4319.objecter successfully canceled tick 2021-02-06T22:52:37.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.106:6812/33219 conn(0x7f0f8c030510 legacy=0x7f0f8c0329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:37.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 >> v1:172.21.15.51:6790/0 conn(0x7f0fac08fa70 legacy=0x7f0fac12c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:37.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 shutdown_connections 2021-02-06T22:52:37.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.015+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 >> 172.21.15.51:0/996585394 conn(0x7f0fac096860 msgr2=0x7f0fac093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:37.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.016+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 shutdown_connections 2021-02-06T22:52:37.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.016+0000 7f0fb1bf0700 1 -- 172.21.15.51:0/996585394 wait complete. 2021-02-06T22:52:37.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:37.016+0000 7f0fb1bf0700 1 librados: shutdown 2021-02-06T22:52:37.026 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:40.027 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:40.162 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.162+0000 7fd49f494700 1 Processor -- start 2021-02-06T22:52:40.162 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.162+0000 7fd49f494700 1 -- start start 2021-02-06T22:52:40.163 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.162+0000 7fd49f494700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4980953e0 con 0x7fd49812cd50 2021-02-06T22:52:40.163 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.162+0000 7fd49f494700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd498094900 con 0x7fd49808f510 2021-02-06T22:52:40.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.163+0000 7fd49f494700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd498090dd0 con 0x7fd498091f60 2021-02-06T22:52:40.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.163+0000 7fd49dc91700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd498091f60 0x7fd4980941f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59976/0 (socket says 172.21.15.51:59976) 2021-02-06T22:52:40.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.163+0000 7fd49dc91700 1 -- 172.21.15.51:0/1303500070 learned_addr learned my addr 172.21.15.51:0/1303500070 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:40.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.163+0000 7fd49ec93700 1 --1- 172.21.15.51:0/1303500070 >> v1:172.21.15.51:6789/0 conn(0x7fd49812cd50 0x7fd49812f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59632/0 (socket says 172.21.15.51:59632) 2021-02-06T22:52:40.166 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49dc91700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.51:6790/0 conn(0x7fd498091f60 legacy=0x7fd4980941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49ec93700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.51:6789/0 conn(0x7fd49812cd50 legacy=0x7fd49812f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49e492700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.106:6789/0 conn(0x7fd49808f510 legacy=0x7fd498093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041242827 0 0) 0x7fd498090dd0 con 0x7fd498091f60 2021-02-06T22:52:40.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd480003230 con 0x7fd498091f60 2021-02-06T22:52:40.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175046893 0 0) 0x7fd4980953e0 con 0x7fd49812cd50 2021-02-06T22:52:40.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd498090dd0 con 0x7fd49812cd50 2021-02-06T22:52:40.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790608040 0 0) 0x7fd498094900 con 0x7fd49808f510 2021-02-06T22:52:40.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.165+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4980953e0 con 0x7fd49808f510 2021-02-06T22:52:40.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 525062963 0 0) 0x7fd480003230 con 0x7fd498091f60 2021-02-06T22:52:40.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.106:6789/0 conn(0x7fd49808f510 legacy=0x7fd498093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.51:6789/0 conn(0x7fd49812cd50 legacy=0x7fd49812f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498091070 con 0x7fd498091f60 2021-02-06T22:52:40.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd494001930 con 0x7fd498091f60 2021-02-06T22:52:40.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd494001c40 con 0x7fd498091f60 2021-02-06T22:52:40.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49d490700 1 -- 172.21.15.51:0/1303500070 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd494004750 con 0x7fd498091f60 2021-02-06T22:52:40.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49f494700 1 -- 172.21.15.51:0/1303500070 >> v1:172.21.15.51:6790/0 conn(0x7fd498091f60 legacy=0x7fd4980941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49f494700 1 -- 172.21.15.51:0/1303500070 shutdown_connections 2021-02-06T22:52:40.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49f494700 1 -- 172.21.15.51:0/1303500070 >> 172.21.15.51:0/1303500070 conn(0x7fd498095be0 msgr2=0x7fd498095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:40.171 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49f494700 1 -- 172.21.15.51:0/1303500070 shutdown_connections 2021-02-06T22:52:40.171 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.166+0000 7fd49f494700 1 -- 172.21.15.51:0/1303500070 wait complete. 2021-02-06T22:52:40.174 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 librados: starting msgr at 2021-02-06T22:52:40.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 librados: starting objecter 2021-02-06T22:52:40.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 Processor -- start 2021-02-06T22:52:40.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 -- start start 2021-02-06T22:52:40.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 librados: setting wanted keys 2021-02-06T22:52:40.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.167+0000 7fd49f494700 1 librados: calling monclient init 2021-02-06T22:52:40.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.168+0000 7fd49f494700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49813a2d0 con 0x7fd49808f510 2021-02-06T22:52:40.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.168+0000 7fd49f494700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4981162a0 con 0x7fd498091f60 2021-02-06T22:52:40.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.168+0000 7fd49f494700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd498116540 con 0x7fd49812cd50 2021-02-06T22:52:40.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.168+0000 7fd49e492700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd49808f510 0x7fd498127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59636/0 (socket says 172.21.15.51:59636) 2021-02-06T22:52:40.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.168+0000 7fd49e492700 1 -- 172.21.15.51:0/1803814184 learned_addr learned my addr 172.21.15.51:0/1803814184 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:40.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd49e492700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.51:6789/0 conn(0x7fd49808f510 legacy=0x7fd498127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd49ec93700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.51:6790/0 conn(0x7fd49812cd50 legacy=0x7fd498141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter ms_handle_connect 0x7fd49808f510 2021-02-06T22:52:40.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:40.178 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter ms_handle_connect 0x7fd49812cd50 2021-02-06T22:52:40.178 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:40.178 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter ms_handle_connect 0x7fd498091f60 2021-02-06T22:52:40.178 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:40.179 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd49dc91700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.106:6789/0 conn(0x7fd498091f60 legacy=0x7fd49813e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:40.179 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342998541 0 0) 0x7fd49813a2d0 con 0x7fd49808f510 2021-02-06T22:52:40.179 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd478004bd0 con 0x7fd49808f510 2021-02-06T22:52:40.179 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130187922 0 0) 0x7fd498116540 con 0x7fd49812cd50 2021-02-06T22:52:40.179 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd49813a2d0 con 0x7fd49812cd50 2021-02-06T22:52:40.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567517458 0 0) 0x7fd4981162a0 con 0x7fd498091f60 2021-02-06T22:52:40.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd498116540 con 0x7fd498091f60 2021-02-06T22:52:40.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2664183039 0 0) 0x7fd49813a2d0 con 0x7fd49812cd50 2021-02-06T22:52:40.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd4981162a0 con 0x7fd49812cd50 2021-02-06T22:52:40.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2395516049 0 0) 0x7fd478004bd0 con 0x7fd49808f510 2021-02-06T22:52:40.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd49813a2d0 con 0x7fd49808f510 2021-02-06T22:52:40.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.170+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd490001fe0 con 0x7fd49812cd50 2021-02-06T22:52:40.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd48c001c30 con 0x7fd49808f510 2021-02-06T22:52:40.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3458388672 0 0) 0x7fd498116540 con 0x7fd498091f60 2021-02-06T22:52:40.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd478004bd0 con 0x7fd498091f60 2021-02-06T22:52:40.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd4940018f0 con 0x7fd498091f60 2021-02-06T22:52:40.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3500903475 0 0) 0x7fd4981162a0 con 0x7fd49812cd50 2021-02-06T22:52:40.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.106:6789/0 conn(0x7fd498091f60 legacy=0x7fd49813e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.51:6789/0 conn(0x7fd49808f510 legacy=0x7fd498127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd498128200 con 0x7fd49812cd50 2021-02-06T22:52:40.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd498114eb0 con 0x7fd49812cd50 2021-02-06T22:52:40.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd49f494700 10 client.4325.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:40.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd498137a50 con 0x7fd49812cd50 2021-02-06T22:52:40.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd49f494700 1 librados: init done 2021-02-06T22:52:40.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd490004c10 con 0x7fd49812cd50 2021-02-06T22:52:40.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd490004f20 con 0x7fd49812cd50 2021-02-06T22:52:40.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.171+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fd490005100 con 0x7fd49812cd50 2021-02-06T22:52:40.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fd490039780 con 0x7fd49812cd50 2021-02-06T22:52:40.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd48a7fc700 10 client.4325.objecter ms_dispatch 0x7fd498001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:40.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd48a7fc700 3 client.4325.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:40.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd48a7fc700 3 client.4325.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:40.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd48a7fc700 20 client.4325.objecter dump_active .. 0 homeless 2021-02-06T22:52:40.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.172+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c004d60 con 0x7fd49812cd50 2021-02-06T22:52:40.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.174+0000 7fd48a7fc700 10 client.4325.objecter ms_handle_connect 0x7fd4780307f0 2021-02-06T22:52:40.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.176+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd490012670 con 0x7fd49812cd50 2021-02-06T22:52:40.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.433+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd47c0059b0 con 0x7fd49812cd50 2021-02-06T22:52:40.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.434+0000 7fd48a7fc700 1 -- 172.21.15.51:0/1803814184 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fd490012260 con 0x7fd49812cd50 2021-02-06T22:52:40.434 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:40.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 10 librados: watch_flush enter 2021-02-06T22:52:40.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 10 librados: watch_flush exit 2021-02-06T22:52:40.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 20 client.4325.objecter shutdown clearing up homeless session... 2021-02-06T22:52:40.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 10 client.4325.objecter successfully canceled tick 2021-02-06T22:52:40.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.106:6812/33219 conn(0x7fd4780307f0 legacy=0x7fd478032cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.435+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 >> v1:172.21.15.51:6790/0 conn(0x7fd49812cd50 legacy=0x7fd498141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:40.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.436+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 shutdown_connections 2021-02-06T22:52:40.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.436+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 >> 172.21.15.51:0/1803814184 conn(0x7fd498095be0 msgr2=0x7fd498066e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:40.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.436+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 shutdown_connections 2021-02-06T22:52:40.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.436+0000 7fd49f494700 1 -- 172.21.15.51:0/1803814184 wait complete. 2021-02-06T22:52:40.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:40.436+0000 7fd49f494700 1 librados: shutdown 2021-02-06T22:52:40.447 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:43.448 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:43.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc904d19700 1 Processor -- start 2021-02-06T22:52:43.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc904d19700 1 -- start start 2021-02-06T22:52:43.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc904d19700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900095440 con 0x7fc90008fa70 2021-02-06T22:52:43.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc904d19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9000907b0 con 0x7fc900092bf0 2021-02-06T22:52:43.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc904d19700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900091010 con 0x7fc90012ce00 2021-02-06T22:52:43.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc8fe59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fc90008fa70 0x7fc9000921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59644/0 (socket says 172.21.15.51:59644) 2021-02-06T22:52:43.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.583+0000 7fc8fe59c700 1 -- 172.21.15.51:0/3392946502 learned_addr learned my addr 172.21.15.51:0/3392946502 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:43.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fe59c700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.51:6789/0 conn(0x7fc90008fa70 legacy=0x7fc9000921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fed9d700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.51:6790/0 conn(0x7fc90012ce00 legacy=0x7fc90012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347939613 0 0) 0x7fc900095440 con 0x7fc90008fa70 2021-02-06T22:52:43.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e4003230 con 0x7fc90008fa70 2021-02-06T22:52:43.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2747329318 0 0) 0x7fc900091010 con 0x7fc90012ce00 2021-02-06T22:52:43.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc900095440 con 0x7fc90012ce00 2021-02-06T22:52:43.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fdd9b700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.106:6789/0 conn(0x7fc900092bf0 legacy=0x7fc9000930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1347995480 0 0) 0x7fc900095440 con 0x7fc90012ce00 2021-02-06T22:52:43.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.106:6789/0 conn(0x7fc900092bf0 legacy=0x7fc9000930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.51:6789/0 conn(0x7fc90008fa70 legacy=0x7fc9000921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000912b0 con 0x7fc90012ce00 2021-02-06T22:52:43.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc8f8001d00 con 0x7fc90012ce00 2021-02-06T22:52:43.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fed9d700 1 --1- 172.21.15.51:0/3392946502 >> v1:172.21.15.51:6790/0 conn(0x7fc90012ce00 0x7fc90012f1f0 :-1 s=OPENED pgs=110 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fc8f8002010 config(0 keys) v1 2021-02-06T22:52:43.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.586+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8f8002010 con 0x7fc90012ce00 2021-02-06T22:52:43.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc904d19700 1 -- 172.21.15.51:0/3392946502 >> v1:172.21.15.51:6790/0 conn(0x7fc90012ce00 legacy=0x7fc90012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc8fd59a700 1 -- 172.21.15.51:0/3392946502 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc8f80023e0 con 0x7fc90012ce00 2021-02-06T22:52:43.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc904d19700 1 -- 172.21.15.51:0/3392946502 shutdown_connections 2021-02-06T22:52:43.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc904d19700 1 -- 172.21.15.51:0/3392946502 >> 172.21.15.51:0/3392946502 conn(0x7fc900096860 msgr2=0x7fc900099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:43.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc904d19700 1 -- 172.21.15.51:0/3392946502 shutdown_connections 2021-02-06T22:52:43.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.587+0000 7fc904d19700 1 -- 172.21.15.51:0/3392946502 wait complete. 2021-02-06T22:52:43.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 librados: starting msgr at 2021-02-06T22:52:43.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 librados: starting objecter 2021-02-06T22:52:43.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 Processor -- start 2021-02-06T22:52:43.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 -- start start 2021-02-06T22:52:43.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 librados: setting wanted keys 2021-02-06T22:52:43.595 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 librados: calling monclient init 2021-02-06T22:52:43.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900090bf0 con 0x7fc900092bf0 2021-02-06T22:52:43.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900097f70 con 0x7fc90012ce00 2021-02-06T22:52:43.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc904d19700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900116df0 con 0x7fc90008fa70 2021-02-06T22:52:43.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc8fe59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fc90008fa70 0x7fc900097150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:59992/0 (socket says 172.21.15.51:59992) 2021-02-06T22:52:43.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.588+0000 7fc8fe59c700 1 -- 172.21.15.51:0/3636894274 learned_addr learned my addr 172.21.15.51:0/3636894274 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:43.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.590+0000 7fc8fe59c700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.51:6790/0 conn(0x7fc90008fa70 legacy=0x7fc900097150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8fdd9b700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.51:6789/0 conn(0x7fc900092bf0 legacy=0x7fc900097860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter ms_handle_connect 0x7fc90008fa70 2021-02-06T22:52:43.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:43.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter ms_handle_connect 0x7fc900092bf0 2021-02-06T22:52:43.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:43.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076395664 0 0) 0x7fc900116df0 con 0x7fc90008fa70 2021-02-06T22:52:43.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc004bd0 con 0x7fc90008fa70 2021-02-06T22:52:43.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631918991 0 0) 0x7fc900090bf0 con 0x7fc900092bf0 2021-02-06T22:52:43.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc900116df0 con 0x7fc900092bf0 2021-02-06T22:52:43.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter ms_handle_connect 0x7fc90012ce00 2021-02-06T22:52:43.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:43.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8fed9d700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.106:6789/0 conn(0x7fc90012ce00 legacy=0x7fc900141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:43.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2579358886 0 0) 0x7fc8dc004bd0 con 0x7fc90008fa70 2021-02-06T22:52:43.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc900090bf0 con 0x7fc90008fa70 2021-02-06T22:52:43.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335143811 0 0) 0x7fc900097f70 con 0x7fc90012ce00 2021-02-06T22:52:43.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc004bd0 con 0x7fc90012ce00 2021-02-06T22:52:43.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc8f00044f0 con 0x7fc90008fa70 2021-02-06T22:52:43.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3161683839 0 0) 0x7fc900116df0 con 0x7fc900092bf0 2021-02-06T22:52:43.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc900097f70 con 0x7fc900092bf0 2021-02-06T22:52:43.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc8f4001b60 con 0x7fc900092bf0 2021-02-06T22:52:43.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 100856994 0 0) 0x7fc900090bf0 con 0x7fc90008fa70 2021-02-06T22:52:43.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.106:6789/0 conn(0x7fc90012ce00 legacy=0x7fc900141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.51:6789/0 conn(0x7fc900092bf0 legacy=0x7fc900097860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900117090 con 0x7fc90008fa70 2021-02-06T22:52:43.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90012ca10 con 0x7fc90008fa70 2021-02-06T22:52:43.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc904d19700 10 client.4331.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:43.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc900117610 con 0x7fc90008fa70 2021-02-06T22:52:43.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc904d19700 1 librados: init done 2021-02-06T22:52:43.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc8f0004980 con 0x7fc90008fa70 2021-02-06T22:52:43.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.591+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc8f0004c90 con 0x7fc90008fa70 2021-02-06T22:52:43.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fc8f000d450 con 0x7fc90008fa70 2021-02-06T22:52:43.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fc8f00394d0 con 0x7fc90008fa70 2021-02-06T22:52:43.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 10 client.4331.objecter ms_dispatch 0x7fc900001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:43.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 3 client.4331.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:43.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 3 client.4331.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:43.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc8ee7fc700 20 client.4331.objecter dump_active .. 0 homeless 2021-02-06T22:52:43.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.592+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0004d60 con 0x7fc90008fa70 2021-02-06T22:52:43.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.595+0000 7fc8ee7fc700 10 client.4331.objecter ms_handle_connect 0x7fc8dc030740 2021-02-06T22:52:43.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.596+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fc8f0012370 con 0x7fc90008fa70 2021-02-06T22:52:43.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.843+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc8e00059b0 con 0x7fc90008fa70 2021-02-06T22:52:43.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.843+0000 7fc8ee7fc700 1 -- 172.21.15.51:0/3636894274 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fc8f0011f60 con 0x7fc90008fa70 2021-02-06T22:52:43.844 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:43.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 10 librados: watch_flush enter 2021-02-06T22:52:43.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 10 librados: watch_flush exit 2021-02-06T22:52:43.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 20 client.4331.objecter shutdown clearing up homeless session... 2021-02-06T22:52:43.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 10 client.4331.objecter successfully canceled tick 2021-02-06T22:52:43.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.106:6812/33219 conn(0x7fc8dc030740 legacy=0x7fc8dc032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 >> v1:172.21.15.51:6790/0 conn(0x7fc90008fa70 legacy=0x7fc900097150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:43.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 shutdown_connections 2021-02-06T22:52:43.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 >> 172.21.15.51:0/3636894274 conn(0x7fc900096860 msgr2=0x7fc90012e630 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:43.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 shutdown_connections 2021-02-06T22:52:43.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 -- 172.21.15.51:0/3636894274 wait complete. 2021-02-06T22:52:43.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:43.845+0000 7fc904d19700 1 librados: shutdown 2021-02-06T22:52:43.856 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:46.858 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:46.993 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.991+0000 7f8a295bb700 1 Processor -- start 2021-02-06T22:52:46.993 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.991+0000 7f8a295bb700 1 -- start start 2021-02-06T22:52:46.994 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a295bb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240915d0 con 0x7f8a240928d0 2021-02-06T22:52:46.994 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a295bb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24091ac0 con 0x7f8a240629e0 2021-02-06T22:52:46.994 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a295bb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24091d60 con 0x7f8a240999a0 2021-02-06T22:52:46.994 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a237fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8a240928d0 0x7f8a2412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59660/0 (socket says 172.21.15.51:59660) 2021-02-06T22:52:46.995 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a22ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8a240999a0 0x7f8a240907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60002/0 (socket says 172.21.15.51:60002) 2021-02-06T22:52:46.995 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.992+0000 7f8a237fe700 1 -- 172.21.15.51:0/4090551219 learned_addr learned my addr 172.21.15.51:0/4090551219 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:46.997 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.994+0000 7f8a22ffd700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.51:6790/0 conn(0x7f8a240999a0 legacy=0x7f8a240907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:46.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.994+0000 7f8a237fe700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.51:6789/0 conn(0x7f8a240928d0 legacy=0x7f8a2412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:46.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797347747 0 0) 0x7f8a24091d60 con 0x7f8a240999a0 2021-02-06T22:52:46.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a10003230 con 0x7f8a240999a0 2021-02-06T22:52:46.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945689771 0 0) 0x7f8a240915d0 con 0x7f8a240928d0 2021-02-06T22:52:46.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a24091d60 con 0x7f8a240928d0 2021-02-06T22:52:46.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a227fc700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.106:6789/0 conn(0x7f8a240629e0 legacy=0x7f8a24090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:46.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 741900908 0 0) 0x7f8a10003230 con 0x7f8a240999a0 2021-02-06T22:52:46.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.106:6789/0 conn(0x7f8a240629e0 legacy=0x7f8a24090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:46.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.51:6789/0 conn(0x7f8a240928d0 legacy=0x7f8a2412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24092000 con 0x7f8a240999a0 2021-02-06T22:52:47.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a14001930 con 0x7f8a240999a0 2021-02-06T22:52:47.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8a14001c40 con 0x7f8a240999a0 2021-02-06T22:52:47.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a21ffb700 1 -- 172.21.15.51:0/4090551219 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a14004690 con 0x7f8a240999a0 2021-02-06T22:52:47.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a295bb700 1 -- 172.21.15.51:0/4090551219 >> v1:172.21.15.51:6790/0 conn(0x7f8a240999a0 legacy=0x7f8a240907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.001 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a295bb700 1 -- 172.21.15.51:0/4090551219 shutdown_connections 2021-02-06T22:52:47.001 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.995+0000 7f8a295bb700 1 -- 172.21.15.51:0/4090551219 >> 172.21.15.51:0/4090551219 conn(0x7f8a24096860 msgr2=0x7f8a24099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:47.001 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.996+0000 7f8a295bb700 1 -- 172.21.15.51:0/4090551219 shutdown_connections 2021-02-06T22:52:47.001 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.996+0000 7f8a295bb700 1 -- 172.21.15.51:0/4090551219 wait complete. 2021-02-06T22:52:47.001 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.996+0000 7f8a295bb700 1 librados: starting msgr at 2021-02-06T22:52:47.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.996+0000 7f8a295bb700 1 librados: starting objecter 2021-02-06T22:52:47.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.996+0000 7f8a295bb700 1 Processor -- start 2021-02-06T22:52:47.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 -- start start 2021-02-06T22:52:47.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 librados: setting wanted keys 2021-02-06T22:52:47.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 librados: calling monclient init 2021-02-06T22:52:47.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24095160 con 0x7f8a240999a0 2021-02-06T22:52:47.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2411a600 con 0x7f8a240928d0 2021-02-06T22:52:47.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a295bb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24067550 con 0x7f8a240629e0 2021-02-06T22:52:47.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a22ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8a240629e0 0x7f8a24139c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60004/0 (socket says 172.21.15.51:60004) 2021-02-06T22:52:47.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a237fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8a240999a0 0x7f8a24141b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59666/0 (socket says 172.21.15.51:59666) 2021-02-06T22:52:47.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.997+0000 7f8a22ffd700 1 -- 172.21.15.51:0/593930153 learned_addr learned my addr 172.21.15.51:0/593930153 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:47.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a22ffd700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.51:6790/0 conn(0x7f8a240629e0 legacy=0x7f8a24139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:47.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a237fe700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.51:6789/0 conn(0x7f8a240999a0 legacy=0x7f8a24141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:47.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter ms_handle_connect 0x7f8a240629e0 2021-02-06T22:52:47.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:47.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter ms_handle_connect 0x7f8a240999a0 2021-02-06T22:52:47.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:47.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635497728 0 0) 0x7f8a24067550 con 0x7f8a240629e0 2021-02-06T22:52:47.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a227fc700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.106:6789/0 conn(0x7f8a240928d0 legacy=0x7f8a241336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:47.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a04004bd0 con 0x7f8a240629e0 2021-02-06T22:52:47.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter ms_handle_connect 0x7f8a240928d0 2021-02-06T22:52:47.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:47.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388204763 0 0) 0x7f8a24095160 con 0x7f8a240999a0 2021-02-06T22:52:47.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:46.999+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a24067550 con 0x7f8a240999a0 2021-02-06T22:52:47.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314992359 0 0) 0x7f8a2411a600 con 0x7f8a240928d0 2021-02-06T22:52:47.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a24095160 con 0x7f8a240928d0 2021-02-06T22:52:47.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3487692634 0 0) 0x7f8a24067550 con 0x7f8a240999a0 2021-02-06T22:52:47.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8a2411a600 con 0x7f8a240999a0 2021-02-06T22:52:47.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a1c001f60 con 0x7f8a240999a0 2021-02-06T22:52:47.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 401997181 0 0) 0x7f8a04004bd0 con 0x7f8a240629e0 2021-02-06T22:52:47.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8a24067550 con 0x7f8a240629e0 2021-02-06T22:52:47.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a14004690 con 0x7f8a240629e0 2021-02-06T22:52:47.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1720621993 0 0) 0x7f8a2411a600 con 0x7f8a240999a0 2021-02-06T22:52:47.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.51:6790/0 conn(0x7f8a240629e0 legacy=0x7f8a24139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.106:6789/0 conn(0x7f8a240928d0 legacy=0x7f8a241336f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24133e00 con 0x7f8a240999a0 2021-02-06T22:52:47.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a24119c00 con 0x7f8a240999a0 2021-02-06T22:52:47.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a295bb700 10 client.4350.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:47.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a241185c0 con 0x7f8a240999a0 2021-02-06T22:52:47.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a295bb700 1 librados: init done 2021-02-06T22:52:47.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8a1c004b20 con 0x7f8a240999a0 2021-02-06T22:52:47.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.000+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a1c004e30 con 0x7f8a240999a0 2021-02-06T22:52:47.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f8a1c00d630 con 0x7f8a240999a0 2021-02-06T22:52:47.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f8a1c039730 con 0x7f8a240999a0 2021-02-06T22:52:47.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 10 client.4350.objecter ms_dispatch 0x7f8a24001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:47.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 3 client.4350.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:47.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 3 client.4350.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:47.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a0affd700 20 client.4350.objecter dump_active .. 0 homeless 2021-02-06T22:52:47.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.001+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc004d60 con 0x7f8a240999a0 2021-02-06T22:52:47.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.003+0000 7f8a0affd700 10 client.4350.objecter ms_handle_connect 0x7f8a04030740 2021-02-06T22:52:47.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.005+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f8a1c012620 con 0x7f8a240999a0 2021-02-06T22:52:47.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.251+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f89fc0059b0 con 0x7f8a240999a0 2021-02-06T22:52:47.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.252+0000 7f8a0affd700 1 -- 172.21.15.51:0/593930153 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f8a1c012210 con 0x7f8a240999a0 2021-02-06T22:52:47.252 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:47.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 10 librados: watch_flush enter 2021-02-06T22:52:47.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 10 librados: watch_flush exit 2021-02-06T22:52:47.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 20 client.4350.objecter shutdown clearing up homeless session... 2021-02-06T22:52:47.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 10 client.4350.objecter successfully canceled tick 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.106:6812/33219 conn(0x7f8a04030740 legacy=0x7f8a04032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 >> v1:172.21.15.51:6789/0 conn(0x7f8a240999a0 legacy=0x7f8a24141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 shutdown_connections 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 >> 172.21.15.51:0/593930153 conn(0x7f8a24096860 msgr2=0x7f8a24067760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 shutdown_connections 2021-02-06T22:52:47.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 -- 172.21.15.51:0/593930153 wait complete. 2021-02-06T22:52:47.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:47.253+0000 7f8a295bb700 1 librados: shutdown 2021-02-06T22:52:47.264 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:50.265 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:50.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.400+0000 7f5111868700 1 Processor -- start 2021-02-06T22:52:50.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.400+0000 7f5111868700 1 -- start start 2021-02-06T22:52:50.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f5111868700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c0915d0 con 0x7f510c0928d0 2021-02-06T22:52:50.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f5111868700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c091ac0 con 0x7f510c0999a0 2021-02-06T22:52:50.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f5111868700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c091d60 con 0x7f510c0629e0 2021-02-06T22:52:50.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f510b7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f510c0928d0 0x7f510c12fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59674/0 (socket says 172.21.15.51:59674) 2021-02-06T22:52:50.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f510a7fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 0x7f510c090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60014/0 (socket says 172.21.15.51:60014) 2021-02-06T22:52:50.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.401+0000 7f510b7fe700 1 -- 172.21.15.51:0/514799938 learned_addr learned my addr 172.21.15.51:0/514799938 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:50.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.403+0000 7f510a7fc700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 legacy=0x7f510c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.403+0000 7f510b7fe700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.51:6789/0 conn(0x7f510c0928d0 legacy=0x7f510c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.403+0000 7f510affd700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.106:6789/0 conn(0x7f510c0999a0 legacy=0x7f510c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075826167 0 0) 0x7f510c091d60 con 0x7f510c0629e0 2021-02-06T22:52:50.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f8003230 con 0x7f510c0629e0 2021-02-06T22:52:50.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870342319 0 0) 0x7f510c0915d0 con 0x7f510c0928d0 2021-02-06T22:52:50.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c091d60 con 0x7f510c0928d0 2021-02-06T22:52:50.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915701221 0 0) 0x7f510c091ac0 con 0x7f510c0999a0 2021-02-06T22:52:50.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c0915d0 con 0x7f510c0999a0 2021-02-06T22:52:50.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3125647057 0 0) 0x7f50f8003230 con 0x7f510c0629e0 2021-02-06T22:52:50.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.106:6789/0 conn(0x7f510c0999a0 legacy=0x7f510c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.51:6789/0 conn(0x7f510c0928d0 legacy=0x7f510c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c092000 con 0x7f510c0629e0 2021-02-06T22:52:50.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f51000019f0 con 0x7f510c0629e0 2021-02-06T22:52:50.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5100001ca0 con 0x7f510c0629e0 2021-02-06T22:52:50.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5109ffb700 1 -- 172.21.15.51:0/514799938 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5100004690 con 0x7f510c0629e0 2021-02-06T22:52:50.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5111868700 1 -- 172.21.15.51:0/514799938 >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 legacy=0x7f510c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.404+0000 7f5111868700 1 -- 172.21.15.51:0/514799938 shutdown_connections 2021-02-06T22:52:50.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.405+0000 7f5111868700 1 -- 172.21.15.51:0/514799938 >> 172.21.15.51:0/514799938 conn(0x7f510c096860 msgr2=0x7f510c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:50.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.405+0000 7f5111868700 1 -- 172.21.15.51:0/514799938 shutdown_connections 2021-02-06T22:52:50.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.405+0000 7f5111868700 1 -- 172.21.15.51:0/514799938 wait complete. 2021-02-06T22:52:50.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.405+0000 7f5111868700 1 librados: starting msgr at 2021-02-06T22:52:50.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.405+0000 7f5111868700 1 librados: starting objecter 2021-02-06T22:52:50.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 Processor -- start 2021-02-06T22:52:50.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 -- start start 2021-02-06T22:52:50.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 librados: setting wanted keys 2021-02-06T22:52:50.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 librados: calling monclient init 2021-02-06T22:52:50.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c094730 con 0x7f510c0999a0 2021-02-06T22:52:50.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c13a6c0 con 0x7f510c0928d0 2021-02-06T22:52:50.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f5111868700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c11a5d0 con 0x7f510c0629e0 2021-02-06T22:52:50.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f510affd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 0x7f510c1398a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60018/0 (socket says 172.21.15.51:60018) 2021-02-06T22:52:50.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.406+0000 7f510affd700 1 -- 172.21.15.51:0/564504326 learned_addr learned my addr 172.21.15.51:0/564504326 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:50.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f510b7fe700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.51:6789/0 conn(0x7f510c0999a0 legacy=0x7f510c141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f510affd700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 legacy=0x7f510c1398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f50f2ffd700 10 client.?.objecter ms_handle_connect 0x7f510c0999a0 2021-02-06T22:52:50.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f50f2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:50.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f50f2ffd700 10 client.?.objecter ms_handle_connect 0x7f510c0629e0 2021-02-06T22:52:50.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.408+0000 7f50f2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:50.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 10 client.?.objecter ms_handle_connect 0x7f510c0928d0 2021-02-06T22:52:50.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:50.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f510a7fc700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.106:6789/0 conn(0x7f510c0928d0 legacy=0x7f510c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:50.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 680325498 0 0) 0x7f510c094730 con 0x7f510c0999a0 2021-02-06T22:52:50.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50ec004bd0 con 0x7f510c0999a0 2021-02-06T22:52:50.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490808721 0 0) 0x7f510c11a5d0 con 0x7f510c0629e0 2021-02-06T22:52:50.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c094730 con 0x7f510c0629e0 2021-02-06T22:52:50.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951082606 0 0) 0x7f510c13a6c0 con 0x7f510c0928d0 2021-02-06T22:52:50.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f510c11a5d0 con 0x7f510c0928d0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1230941631 0 0) 0x7f510c094730 con 0x7f510c0629e0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f510c13a6c0 con 0x7f510c0629e0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1195307598 0 0) 0x7f50ec004bd0 con 0x7f510c0999a0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f510c094730 con 0x7f510c0999a0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f50fc001ca0 con 0x7f510c0629e0 2021-02-06T22:52:50.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5104001fe0 con 0x7f510c0999a0 2021-02-06T22:52:50.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4174787164 0 0) 0x7f510c094730 con 0x7f510c0999a0 2021-02-06T22:52:50.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.51:6790/0 conn(0x7f510c0629e0 legacy=0x7f510c1398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.106:6789/0 conn(0x7f510c0928d0 legacy=0x7f510c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c115150 con 0x7f510c0999a0 2021-02-06T22:52:50.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c093e50 con 0x7f510c0999a0 2021-02-06T22:52:50.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f5111868700 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:50.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c130b50 con 0x7f510c0999a0 2021-02-06T22:52:50.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f5111868700 1 librados: init done 2021-02-06T22:52:50.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5104004b20 con 0x7f510c0999a0 2021-02-06T22:52:50.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.409+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5104004e30 con 0x7f510c0999a0 2021-02-06T22:52:50.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f510400d5f0 con 0x7f510c0999a0 2021-02-06T22:52:50.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f5104039690 con 0x7f510c0999a0 2021-02-06T22:52:50.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 10 client.4356.objecter ms_dispatch 0x7f510c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:50.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 3 client.4356.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:50.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 3 client.4356.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:50.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f50f2ffd700 20 client.4356.objecter dump_active .. 0 homeless 2021-02-06T22:52:50.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.410+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e4004d60 con 0x7f510c0999a0 2021-02-06T22:52:50.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.413+0000 7f50f2ffd700 10 client.4356.objecter ms_handle_connect 0x7f50ec0304b0 2021-02-06T22:52:50.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.414+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f5104012520 con 0x7f510c0999a0 2021-02-06T22:52:50.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.664+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f50e40059b0 con 0x7f510c0999a0 2021-02-06T22:52:50.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.665+0000 7f50f2ffd700 1 -- 172.21.15.51:0/564504326 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f5104012110 con 0x7f510c0999a0 2021-02-06T22:52:50.665 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:50.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 10 librados: watch_flush enter 2021-02-06T22:52:50.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 10 librados: watch_flush exit 2021-02-06T22:52:50.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 20 client.4356.objecter shutdown clearing up homeless session... 2021-02-06T22:52:50.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 10 client.4356.objecter successfully canceled tick 2021-02-06T22:52:50.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.106:6812/33219 conn(0x7f50ec0304b0 legacy=0x7f50ec032970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 >> v1:172.21.15.51:6789/0 conn(0x7f510c0999a0 legacy=0x7f510c141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:50.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 shutdown_connections 2021-02-06T22:52:50.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 >> 172.21.15.51:0/564504326 conn(0x7f510c096860 msgr2=0x7f510c0668c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:50.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 shutdown_connections 2021-02-06T22:52:50.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 -- 172.21.15.51:0/564504326 wait complete. 2021-02-06T22:52:50.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:50.666+0000 7f5111868700 1 librados: shutdown 2021-02-06T22:52:50.678 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:53.679 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:53.815 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.814+0000 7ffa964e0700 1 Processor -- start 2021-02-06T22:52:53.815 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.814+0000 7ffa964e0700 1 -- start start 2021-02-06T22:52:53.815 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.814+0000 7ffa964e0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90095440 con 0x7ffa90092bf0 2021-02-06T22:52:53.815 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.814+0000 7ffa964e0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa900907b0 con 0x7ffa9012ce00 2021-02-06T22:52:53.816 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.814+0000 7ffa964e0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90091010 con 0x7ffa9008fa70 2021-02-06T22:52:53.816 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.815+0000 7ffa8ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ffa9008fa70 0x7ffa900921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60026/0 (socket says 172.21.15.51:60026) 2021-02-06T22:52:53.816 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.815+0000 7ffa8f7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ffa90092bf0 0x7ffa900930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59688/0 (socket says 172.21.15.51:59688) 2021-02-06T22:52:53.816 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.815+0000 7ffa8ffff700 1 -- 172.21.15.51:0/3884741933 learned_addr learned my addr 172.21.15.51:0/3884741933 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:53.818 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8f7fe700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.51:6789/0 conn(0x7ffa90092bf0 legacy=0x7ffa900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.819 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8ffff700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.51:6790/0 conn(0x7ffa9008fa70 legacy=0x7ffa900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.819 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa94a7d700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.106:6789/0 conn(0x7ffa9012ce00 legacy=0x7ffa9012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.819 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204301450 0 0) 0x7ffa90091010 con 0x7ffa9008fa70 2021-02-06T22:52:53.819 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa7c003230 con 0x7ffa9008fa70 2021-02-06T22:52:53.819 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946971212 0 0) 0x7ffa90095440 con 0x7ffa90092bf0 2021-02-06T22:52:53.820 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90091010 con 0x7ffa90092bf0 2021-02-06T22:52:53.820 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661676391 0 0) 0x7ffa900907b0 con 0x7ffa9012ce00 2021-02-06T22:52:53.820 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90095440 con 0x7ffa9012ce00 2021-02-06T22:52:53.820 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3634867104 0 0) 0x7ffa7c003230 con 0x7ffa9008fa70 2021-02-06T22:52:53.820 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.106:6789/0 conn(0x7ffa9012ce00 legacy=0x7ffa9012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:53.821 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.51:6789/0 conn(0x7ffa90092bf0 legacy=0x7ffa900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:53.821 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900912b0 con 0x7ffa9008fa70 2021-02-06T22:52:53.821 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.817+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa80001860 con 0x7ffa9008fa70 2021-02-06T22:52:53.821 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa84001930 con 0x7ffa90092bf0 2021-02-06T22:52:53.821 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffa80001b70 con 0x7ffa9008fa70 2021-02-06T22:52:53.822 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa8effd700 1 -- 172.21.15.51:0/3884741933 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa800045b0 con 0x7ffa9008fa70 2021-02-06T22:52:53.822 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa964e0700 1 -- 172.21.15.51:0/3884741933 >> v1:172.21.15.51:6790/0 conn(0x7ffa9008fa70 legacy=0x7ffa900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:53.822 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa964e0700 1 -- 172.21.15.51:0/3884741933 shutdown_connections 2021-02-06T22:52:53.822 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa964e0700 1 -- 172.21.15.51:0/3884741933 >> 172.21.15.51:0/3884741933 conn(0x7ffa90096860 msgr2=0x7ffa90099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:53.823 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa964e0700 1 -- 172.21.15.51:0/3884741933 shutdown_connections 2021-02-06T22:52:53.823 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.818+0000 7ffa964e0700 1 -- 172.21.15.51:0/3884741933 wait complete. 2021-02-06T22:52:53.827 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 librados: starting msgr at 2021-02-06T22:52:53.827 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 librados: starting objecter 2021-02-06T22:52:53.827 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 Processor -- start 2021-02-06T22:52:53.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 -- start start 2021-02-06T22:52:53.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 librados: setting wanted keys 2021-02-06T22:52:53.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.819+0000 7ffa964e0700 1 librados: calling monclient init 2021-02-06T22:52:53.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa964e0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9012b120 con 0x7ffa9012ce00 2021-02-06T22:52:53.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa964e0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90090bf0 con 0x7ffa9008fa70 2021-02-06T22:52:53.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa964e0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90112150 con 0x7ffa90092bf0 2021-02-06T22:52:53.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa8f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ffa90092bf0 0x7ffa9013c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60034/0 (socket says 172.21.15.51:60034) 2021-02-06T22:52:53.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa94a7d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ffa9012ce00 0x7ffa901400e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59694/0 (socket says 172.21.15.51:59694) 2021-02-06T22:52:53.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.820+0000 7ffa8f7fe700 1 -- 172.21.15.51:0/4094392100 learned_addr learned my addr 172.21.15.51:0/4094392100 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:53.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa8f7fe700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.51:6790/0 conn(0x7ffa90092bf0 legacy=0x7ffa9013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa94a7d700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.51:6789/0 conn(0x7ffa9012ce00 legacy=0x7ffa901400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter ms_handle_connect 0x7ffa90092bf0 2021-02-06T22:52:53.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:53.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter ms_handle_connect 0x7ffa9012ce00 2021-02-06T22:52:53.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:53.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter ms_handle_connect 0x7ffa9008fa70 2021-02-06T22:52:53.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:53.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa8ffff700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.106:6789/0 conn(0x7ffa9008fa70 legacy=0x7ffa9012aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:53.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215705057 0 0) 0x7ffa90112150 con 0x7ffa90092bf0 2021-02-06T22:52:53.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa70004bd0 con 0x7ffa90092bf0 2021-02-06T22:52:53.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595566260 0 0) 0x7ffa9012b120 con 0x7ffa9012ce00 2021-02-06T22:52:53.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa90112150 con 0x7ffa9012ce00 2021-02-06T22:52:53.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516410323 0 0) 0x7ffa90090bf0 con 0x7ffa9008fa70 2021-02-06T22:52:53.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9012b120 con 0x7ffa9008fa70 2021-02-06T22:52:53.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1462390872 0 0) 0x7ffa70004bd0 con 0x7ffa90092bf0 2021-02-06T22:52:53.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa90090bf0 con 0x7ffa90092bf0 2021-02-06T22:52:53.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2465416371 0 0) 0x7ffa90112150 con 0x7ffa9012ce00 2021-02-06T22:52:53.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffa70004bd0 con 0x7ffa9012ce00 2021-02-06T22:52:53.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.822+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa840044f0 con 0x7ffa90092bf0 2021-02-06T22:52:53.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa88001f60 con 0x7ffa9012ce00 2021-02-06T22:52:53.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 489602861 0 0) 0x7ffa90090bf0 con 0x7ffa90092bf0 2021-02-06T22:52:53.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.106:6789/0 conn(0x7ffa9008fa70 legacy=0x7ffa9012aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:53.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.51:6789/0 conn(0x7ffa9012ce00 legacy=0x7ffa901400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:53.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa901123f0 con 0x7ffa90092bf0 2021-02-06T22:52:53.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa90132350 con 0x7ffa90092bf0 2021-02-06T22:52:53.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa964e0700 10 client.4349.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:53.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9010ffe0 con 0x7ffa90092bf0 2021-02-06T22:52:53.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa964e0700 1 librados: init done 2021-02-06T22:52:53.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ffa84004980 con 0x7ffa90092bf0 2021-02-06T22:52:53.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ffa84004c90 con 0x7ffa90092bf0 2021-02-06T22:52:53.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.823+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ffa84004df0 con 0x7ffa90092bf0 2021-02-06T22:52:53.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ffa84039600 con 0x7ffa90092bf0 2021-02-06T22:52:53.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa77fff700 10 client.4349.objecter ms_dispatch 0x7ffa90001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:53.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa77fff700 3 client.4349.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:53.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa77fff700 3 client.4349.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:53.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa77fff700 20 client.4349.objecter dump_active .. 0 homeless 2021-02-06T22:52:53.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.824+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa68004d60 con 0x7ffa90092bf0 2021-02-06T22:52:53.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.826+0000 7ffa77fff700 10 client.4349.objecter ms_handle_connect 0x7ffa70030520 2021-02-06T22:52:53.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:53.828+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7ffa84012490 con 0x7ffa90092bf0 2021-02-06T22:52:54.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.074+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa680059b0 con 0x7ffa90092bf0 2021-02-06T22:52:54.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.074+0000 7ffa77fff700 1 -- 172.21.15.51:0/4094392100 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7ffa84012080 con 0x7ffa90092bf0 2021-02-06T22:52:54.075 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:54.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 10 librados: watch_flush enter 2021-02-06T22:52:54.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 10 librados: watch_flush exit 2021-02-06T22:52:54.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 20 client.4349.objecter shutdown clearing up homeless session... 2021-02-06T22:52:54.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 10 client.4349.objecter successfully canceled tick 2021-02-06T22:52:54.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.106:6812/33219 conn(0x7ffa70030520 legacy=0x7ffa700329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:54.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 >> v1:172.21.15.51:6790/0 conn(0x7ffa90092bf0 legacy=0x7ffa9013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:54.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.075+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 shutdown_connections 2021-02-06T22:52:54.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.076+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 >> 172.21.15.51:0/4094392100 conn(0x7ffa90096860 msgr2=0x7ffa90093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:54.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.076+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 shutdown_connections 2021-02-06T22:52:54.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.076+0000 7ffa964e0700 1 -- 172.21.15.51:0/4094392100 wait complete. 2021-02-06T22:52:54.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:54.076+0000 7ffa964e0700 1 librados: shutdown 2021-02-06T22:52:54.087 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:52:57.088 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:52:57.225 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.223+0000 7f45a699d700 1 Processor -- start 2021-02-06T22:52:57.225 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.223+0000 7f45a699d700 1 -- start start 2021-02-06T22:52:57.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a699d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0099e60 con 0x7f45a00933c0 2021-02-06T22:52:57.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a699d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0097760 con 0x7f45a01275f0 2021-02-06T22:52:57.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a699d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a00940c0 con 0x7f45a0127170 2021-02-06T22:52:57.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a599b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f45a00933c0 0x7f45a0097050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59698/0 (socket says 172.21.15.51:59698) 2021-02-06T22:52:57.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a519a700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f45a0127170 0x7f45a012f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60042/0 (socket says 172.21.15.51:60042) 2021-02-06T22:52:57.228 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.224+0000 7f45a599b700 1 -- 172.21.15.51:0/1402920375 learned_addr learned my addr 172.21.15.51:0/1402920375 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:57.238 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.226+0000 7f45a599b700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.51:6789/0 conn(0x7f45a00933c0 legacy=0x7f45a0097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.226+0000 7f45a519a700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.51:6790/0 conn(0x7f45a0127170 legacy=0x7f45a012f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a619c700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.106:6789/0 conn(0x7f45a01275f0 legacy=0x7f45a0132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283667602 0 0) 0x7f45a00940c0 con 0x7f45a0127170 2021-02-06T22:52:57.240 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4588003230 con 0x7f45a0127170 2021-02-06T22:52:57.240 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308103224 0 0) 0x7f45a0097760 con 0x7f45a01275f0 2021-02-06T22:52:57.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a00940c0 con 0x7f45a01275f0 2021-02-06T22:52:57.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2273637096 0 0) 0x7f4588003230 con 0x7f45a0127170 2021-02-06T22:52:57.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.106:6789/0 conn(0x7f45a01275f0 legacy=0x7f45a0132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.51:6789/0 conn(0x7f45a00933c0 legacy=0x7f45a0097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0127a80 con 0x7f45a0127170 2021-02-06T22:52:57.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f459c001860 con 0x7f45a0127170 2021-02-06T22:52:57.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f459c001b70 con 0x7f45a0127170 2021-02-06T22:52:57.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.227+0000 7f45a4999700 1 -- 172.21.15.51:0/1402920375 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f459c0044f0 con 0x7f45a0127170 2021-02-06T22:52:57.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 -- 172.21.15.51:0/1402920375 >> v1:172.21.15.51:6790/0 conn(0x7f45a0127170 legacy=0x7f45a012f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 -- 172.21.15.51:0/1402920375 shutdown_connections 2021-02-06T22:52:57.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 -- 172.21.15.51:0/1402920375 >> 172.21.15.51:0/1402920375 conn(0x7f45a009a1b0 msgr2=0x7f45a009a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:57.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 -- 172.21.15.51:0/1402920375 shutdown_connections 2021-02-06T22:52:57.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 -- 172.21.15.51:0/1402920375 wait complete. 2021-02-06T22:52:57.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 librados: starting msgr at 2021-02-06T22:52:57.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.228+0000 7f45a699d700 1 librados: starting objecter 2021-02-06T22:52:57.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 Processor -- start 2021-02-06T22:52:57.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 -- start start 2021-02-06T22:52:57.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 librados: setting wanted keys 2021-02-06T22:52:57.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 librados: calling monclient init 2021-02-06T22:52:57.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0121130 con 0x7f45a01275f0 2021-02-06T22:52:57.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0120660 con 0x7f45a0127170 2021-02-06T22:52:57.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a699d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a00678a0 con 0x7f45a00933c0 2021-02-06T22:52:57.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a599b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f45a00933c0 0x7f45a011e180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60046/0 (socket says 172.21.15.51:60046) 2021-02-06T22:52:57.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a599b700 1 -- 172.21.15.51:0/1501168118 learned_addr learned my addr 172.21.15.51:0/1501168118 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:52:57.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.229+0000 7f45a619c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f45a01275f0 0x7f45a01423c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59708/0 (socket says 172.21.15.51:59708) 2021-02-06T22:52:57.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f45a599b700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.51:6790/0 conn(0x7f45a00933c0 legacy=0x7f45a011e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter ms_handle_connect 0x7f45a00933c0 2021-02-06T22:52:57.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f45a619c700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.51:6789/0 conn(0x7f45a01275f0 legacy=0x7f45a01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:57.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter ms_handle_connect 0x7f45a01275f0 2021-02-06T22:52:57.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:57.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999293493 0 0) 0x7f45a00678a0 con 0x7f45a00933c0 2021-02-06T22:52:57.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f45a519a700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.106:6789/0 conn(0x7f45a0127170 legacy=0x7f45a013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:52:57.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4580004bd0 con 0x7f45a00933c0 2021-02-06T22:52:57.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter ms_handle_connect 0x7f45a0127170 2021-02-06T22:52:57.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.231+0000 7f4591ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:52:57.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913856997 0 0) 0x7f45a0121130 con 0x7f45a01275f0 2021-02-06T22:52:57.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a00678a0 con 0x7f45a01275f0 2021-02-06T22:52:57.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945062066 0 0) 0x7f45a0120660 con 0x7f45a0127170 2021-02-06T22:52:57.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a0121130 con 0x7f45a0127170 2021-02-06T22:52:57.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3653027149 0 0) 0x7f4580004bd0 con 0x7f45a00933c0 2021-02-06T22:52:57.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45a0120660 con 0x7f45a00933c0 2021-02-06T22:52:57.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4594001b10 con 0x7f45a00933c0 2021-02-06T22:52:57.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2683106089 0 0) 0x7f45a00678a0 con 0x7f45a01275f0 2021-02-06T22:52:57.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4580004bd0 con 0x7f45a01275f0 2021-02-06T22:52:57.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4598001f80 con 0x7f45a01275f0 2021-02-06T22:52:57.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1104736514 0 0) 0x7f45a0120660 con 0x7f45a00933c0 2021-02-06T22:52:57.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.106:6789/0 conn(0x7f45a0127170 legacy=0x7f45a013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.51:6789/0 conn(0x7f45a01275f0 legacy=0x7f45a01423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0067a30 con 0x7f45a00933c0 2021-02-06T22:52:57.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a011faa0 con 0x7f45a00933c0 2021-02-06T22:52:57.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4594004860 con 0x7f45a00933c0 2021-02-06T22:52:57.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4594004b70 con 0x7f45a00933c0 2021-02-06T22:52:57.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f45a699d700 10 client.4355.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:52:57.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a0123940 con 0x7f45a00933c0 2021-02-06T22:52:57.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.232+0000 7f45a699d700 1 librados: init done 2021-02-06T22:52:57.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4594004d50 con 0x7f45a00933c0 2021-02-06T22:52:57.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f45940394f0 con 0x7f45a00933c0 2021-02-06T22:52:57.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 10 client.4355.objecter ms_dispatch 0x7f45a0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:52:57.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 3 client.4355.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:52:57.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 3 client.4355.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:52:57.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f4591ffb700 20 client.4355.objecter dump_active .. 0 homeless 2021-02-06T22:52:57.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.233+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a0120f80 con 0x7f45a00933c0 2021-02-06T22:52:57.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.236+0000 7f4591ffb700 10 client.4355.objecter ms_handle_connect 0x7f4580030470 2021-02-06T22:52:57.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.237+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f45940123e0 con 0x7f45a00933c0 2021-02-06T22:52:57.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.490+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f45a0061740 con 0x7f45a00933c0 2021-02-06T22:52:57.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.491+0000 7f4591ffb700 1 -- 172.21.15.51:0/1501168118 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f4594011fd0 con 0x7f45a00933c0 2021-02-06T22:52:57.491 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:52:57.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 10 librados: watch_flush enter 2021-02-06T22:52:57.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 10 librados: watch_flush exit 2021-02-06T22:52:57.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 20 client.4355.objecter shutdown clearing up homeless session... 2021-02-06T22:52:57.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 10 client.4355.objecter successfully canceled tick 2021-02-06T22:52:57.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.106:6812/33219 conn(0x7f4580030470 legacy=0x7f4580032930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 >> v1:172.21.15.51:6790/0 conn(0x7f45a00933c0 legacy=0x7f45a011e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:52:57.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 shutdown_connections 2021-02-06T22:52:57.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 >> 172.21.15.51:0/1501168118 conn(0x7f45a009a1b0 msgr2=0x7f45a0124150 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:52:57.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 shutdown_connections 2021-02-06T22:52:57.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 -- 172.21.15.51:0/1501168118 wait complete. 2021-02-06T22:52:57.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:52:57.492+0000 7f45a699d700 1 librados: shutdown 2021-02-06T22:52:57.503 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:00.505 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:00.638 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.638+0000 7f665bbf0700 1 Processor -- start 2021-02-06T22:53:00.639 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665bbf0700 1 -- start start 2021-02-06T22:53:00.640 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665bbf0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66540915d0 con 0x7f66540928d0 2021-02-06T22:53:00.640 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665bbf0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6654091ac0 con 0x7f66540629e0 2021-02-06T22:53:00.640 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665bbf0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6654091d60 con 0x7f66540999a0 2021-02-06T22:53:00.641 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665a18d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f66540928d0 0x7f665412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59714/0 (socket says 172.21.15.51:59714) 2021-02-06T22:53:00.641 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665998c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 0x7f66540907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60054/0 (socket says 172.21.15.51:60054) 2021-02-06T22:53:00.641 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.639+0000 7f665a18d700 1 -- 172.21.15.51:0/815643637 learned_addr learned my addr 172.21.15.51:0/815643637 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:00.644 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.641+0000 7f665a18d700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.51:6789/0 conn(0x7f66540928d0 legacy=0x7f665412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.644 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.641+0000 7f665998c700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f66540907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.645 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945834624 0 0) 0x7f6654091d60 con 0x7f66540999a0 2021-02-06T22:53:00.645 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665918b700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.106:6789/0 conn(0x7f66540629e0 legacy=0x7f6654090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.645 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c003230 con 0x7f66540999a0 2021-02-06T22:53:00.645 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2300121223 0 0) 0x7f66540915d0 con 0x7f66540928d0 2021-02-06T22:53:00.646 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6654091d60 con 0x7f66540928d0 2021-02-06T22:53:00.646 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242372790 0 0) 0x7f6654091ac0 con 0x7f66540629e0 2021-02-06T22:53:00.646 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66540915d0 con 0x7f66540629e0 2021-02-06T22:53:00.646 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4190337731 0 0) 0x7f663c003230 con 0x7f66540999a0 2021-02-06T22:53:00.647 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.106:6789/0 conn(0x7f66540629e0 legacy=0x7f6654090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.647 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.51:6789/0 conn(0x7f66540928d0 legacy=0x7f665412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.647 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654092000 con 0x7f66540999a0 2021-02-06T22:53:00.647 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6648001930 con 0x7f66540999a0 2021-02-06T22:53:00.648 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1497192880 0 0) 0x7f6654091d60 con 0x7f66540928d0 2021-02-06T22:53:00.648 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f664c001cb0 con 0x7f66540928d0 2021-02-06T22:53:00.648 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6648001c40 con 0x7f66540999a0 2021-02-06T22:53:00.648 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665898a700 1 -- 172.21.15.51:0/815643637 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6648004690 con 0x7f66540999a0 2021-02-06T22:53:00.648 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665bbf0700 1 -- 172.21.15.51:0/815643637 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f66540907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.649 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665bbf0700 1 -- 172.21.15.51:0/815643637 shutdown_connections 2021-02-06T22:53:00.649 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.642+0000 7f665bbf0700 1 -- 172.21.15.51:0/815643637 >> 172.21.15.51:0/815643637 conn(0x7f6654096860 msgr2=0x7f6654099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:00.649 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 -- 172.21.15.51:0/815643637 shutdown_connections 2021-02-06T22:53:00.649 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 -- 172.21.15.51:0/815643637 wait complete. 2021-02-06T22:53:00.649 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 librados: starting msgr at 2021-02-06T22:53:00.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 librados: starting objecter 2021-02-06T22:53:00.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 Processor -- start 2021-02-06T22:53:00.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 -- start start 2021-02-06T22:53:00.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 librados: setting wanted keys 2021-02-06T22:53:00.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.643+0000 7f665bbf0700 1 librados: calling monclient init 2021-02-06T22:53:00.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.644+0000 7f665bbf0700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6654133e70 con 0x7f66540629e0 2021-02-06T22:53:00.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.644+0000 7f665bbf0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66541190b0 con 0x7f66540928d0 2021-02-06T22:53:00.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.644+0000 7f665bbf0700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665411b140 con 0x7f66540999a0 2021-02-06T22:53:00.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.644+0000 7f665998c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f66540629e0 0x7f6654139b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59718/0 (socket says 172.21.15.51:59718) 2021-02-06T22:53:00.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.644+0000 7f665998c700 1 -- 172.21.15.51:0/1188072179 learned_addr learned my addr 172.21.15.51:0/1188072179 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:00.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f665998c700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6789/0 conn(0x7f66540629e0 legacy=0x7f6654139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter ms_handle_connect 0x7f66540629e0 2021-02-06T22:53:00.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:00.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter ms_handle_connect 0x7f66540999a0 2021-02-06T22:53:00.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:00.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f665a18d700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f6654141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261884290 0 0) 0x7f6654133e70 con 0x7f66540629e0 2021-02-06T22:53:00.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f665918b700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.106:6789/0 conn(0x7f66540928d0 legacy=0x7f6654133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634004bd0 con 0x7f66540629e0 2021-02-06T22:53:00.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter ms_handle_connect 0x7f66540928d0 2021-02-06T22:53:00.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:00.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901610780 0 0) 0x7f665411b140 con 0x7f66540999a0 2021-02-06T22:53:00.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6654133e70 con 0x7f66540999a0 2021-02-06T22:53:00.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1621540858 0 0) 0x7f66541190b0 con 0x7f66540928d0 2021-02-06T22:53:00.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665411b140 con 0x7f66540928d0 2021-02-06T22:53:00.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.646+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3293939552 0 0) 0x7f6654133e70 con 0x7f66540999a0 2021-02-06T22:53:00.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66541190b0 con 0x7f66540999a0 2021-02-06T22:53:00.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3790687644 0 0) 0x7f6634004bd0 con 0x7f66540629e0 2021-02-06T22:53:00.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6654133e70 con 0x7f66540629e0 2021-02-06T22:53:00.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f664c001fe0 con 0x7f66540999a0 2021-02-06T22:53:00.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f66480018f0 con 0x7f66540629e0 2021-02-06T22:53:00.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3293171898 0 0) 0x7f66541190b0 con 0x7f66540999a0 2021-02-06T22:53:00.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.106:6789/0 conn(0x7f66540928d0 legacy=0x7f6654133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6789/0 conn(0x7f66540629e0 legacy=0x7f6654139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654095160 con 0x7f66540999a0 2021-02-06T22:53:00.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6654067520 con 0x7f66540999a0 2021-02-06T22:53:00.662 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f664c004c10 con 0x7f66540999a0 2021-02-06T22:53:00.662 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f664c004f20 con 0x7f66540999a0 2021-02-06T22:53:00.662 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665bbf0700 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:00.662 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6654118470 con 0x7f66540999a0 2021-02-06T22:53:00.663 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665bbf0700 1 librados: init done 2021-02-06T22:53:00.663 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665a18d700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f6654141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-06T22:53:00.663 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665a18d700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f6654141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:53:00.663 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665a18d700 1 --1- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 0x7f6654141b70 :-1 s=OPENED pgs=123 cs=1 l=1).handle_message read tag failed 2021-02-06T22:53:00.663 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f665a18d700 1 --1- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 0x7f6654141b70 :-1 s=OPENED pgs=123 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:53:00.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f66540999a0 legacy=0x7f6654141b70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:53:00.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f66541190b0 con 0x7f66540629e0 2021-02-06T22:53:00.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f665411b140 con 0x7f66540928d0 2021-02-06T22:53:00.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.647+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 1) v1 -- 0x7f6634004bd0 con 0x7f6634005360 2021-02-06T22:53:00.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f665998c700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f6634005360 legacy=0x7f66340090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f6645ffb700 10 client.4361.objecter ms_handle_connect 0x7f6634005360 2021-02-06T22:53:00.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f6645ffb700 10 client.4361.objecter resend_mon_ops 2021-02-06T22:53:00.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f6645ffb700 10 client.4361.objecter ms_handle_connect 0x7f66540629e0 2021-02-06T22:53:00.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f665a18d700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6789/0 conn(0x7f66540629e0 legacy=0x7f663400ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.649+0000 7f6645ffb700 10 client.4361.objecter resend_mon_ops 2021-02-06T22:53:00.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899578884 0 0) 0x7f6634004bd0 con 0x7f6634005360 2021-02-06T22:53:00.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f665918b700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.106:6789/0 conn(0x7f66540928d0 legacy=0x7f663400c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:00.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634005b70 con 0x7f6634005360 2021-02-06T22:53:00.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 10 client.4361.objecter ms_handle_connect 0x7f66540928d0 2021-02-06T22:53:00.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 10 client.4361.objecter resend_mon_ops 2021-02-06T22:53:00.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465744801 0 0) 0x7f66541190b0 con 0x7f66540629e0 2021-02-06T22:53:00.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6634004bd0 con 0x7f66540629e0 2021-02-06T22:53:00.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049165306 0 0) 0x7f665411b140 con 0x7f66540928d0 2021-02-06T22:53:00.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66541190b0 con 0x7f66540928d0 2021-02-06T22:53:00.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 97826142 0 0) 0x7f6634004bd0 con 0x7f66540629e0 2021-02-06T22:53:00.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f665411b140 con 0x7f66540629e0 2021-02-06T22:53:00.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f664c0056f0 con 0x7f66540629e0 2021-02-06T22:53:00.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 351321063 0 0) 0x7f6634005b70 con 0x7f6634005360 2021-02-06T22:53:00.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6634004bd0 con 0x7f6634005360 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f66480044f0 con 0x7f6634005360 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3635059997 0 0) 0x7f66541190b0 con 0x7f66540928d0 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6634005b70 con 0x7f66540928d0 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6650002470 con 0x7f66540928d0 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4264974255 0 0) 0x7f665411b140 con 0x7f66540629e0 2021-02-06T22:53:00.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6790/0 conn(0x7f6634005360 legacy=0x7f66340090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.106:6789/0 conn(0x7f66540928d0 legacy=0x7f663400c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) v3 -- 0x7f6634005860 con 0x7f66540629e0 2021-02-06T22:53:00.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66540581b0 con 0x7f66540629e0 2021-02-06T22:53:00.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6634004bd0 con 0x7f66540629e0 2021-02-06T22:53:00.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.650+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f664c005c00 con 0x7f66540629e0 2021-02-06T22:53:00.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f664c005df0 con 0x7f66540629e0 2021-02-06T22:53:00.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 7 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f664c03a2c0 con 0x7f66540629e0 2021-02-06T22:53:00.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 10 client.4361.objecter ms_dispatch 0x7f6654001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:00.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 3 client.4361.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:00.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 3 client.4361.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:00.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.651+0000 7f6645ffb700 20 client.4361.objecter dump_active .. 0 homeless 2021-02-06T22:53:00.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.654+0000 7f6645ffb700 10 client.4361.objecter ms_handle_connect 0x7f663403c740 2021-02-06T22:53:00.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.655+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f664c0132d0 con 0x7f66540629e0 2021-02-06T22:53:00.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.658+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f664c012ee0 con 0x7f66540629e0 2021-02-06T22:53:00.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.903+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f66540923c0 con 0x7f66540629e0 2021-02-06T22:53:00.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.904+0000 7f6645ffb700 1 -- 172.21.15.51:0/1188072179 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f664c0130c0 con 0x7f66540629e0 2021-02-06T22:53:00.908 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:00.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 10 librados: watch_flush enter 2021-02-06T22:53:00.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 10 librados: watch_flush exit 2021-02-06T22:53:00.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 20 client.4361.objecter shutdown clearing up homeless session... 2021-02-06T22:53:00.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 10 client.4361.objecter successfully canceled tick 2021-02-06T22:53:00.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.106:6812/33219 conn(0x7f663403c740 legacy=0x7f663403ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 >> v1:172.21.15.51:6789/0 conn(0x7f66540629e0 legacy=0x7f663400ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:00.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 shutdown_connections 2021-02-06T22:53:00.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 >> 172.21.15.51:0/1188072179 conn(0x7f6654096860 msgr2=0x7f6654064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:00.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 shutdown_connections 2021-02-06T22:53:00.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 -- 172.21.15.51:0/1188072179 wait complete. 2021-02-06T22:53:00.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:00.905+0000 7f665bbf0700 1 librados: shutdown 2021-02-06T22:53:00.917 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:03.919 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:04.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.055+0000 7fd5f6faf700 1 Processor -- start 2021-02-06T22:53:04.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.055+0000 7fd5f6faf700 1 -- start start 2021-02-06T22:53:04.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5f6faf700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0095440 con 0x7fd5f0092bf0 2021-02-06T22:53:04.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5f6faf700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f00907b0 con 0x7fd5f012ce00 2021-02-06T22:53:04.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5f6faf700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0091010 con 0x7fd5f008fa70 2021-02-06T22:53:04.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5effff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd5f0092bf0 0x7fd5f00930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59732/0 (socket says 172.21.15.51:59732) 2021-02-06T22:53:04.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5f4d4b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd5f008fa70 0x7fd5f00921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60074/0 (socket says 172.21.15.51:60074) 2021-02-06T22:53:04.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.056+0000 7fd5effff700 1 -- 172.21.15.51:0/4250800356 learned_addr learned my addr 172.21.15.51:0/4250800356 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:04.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.058+0000 7fd5f4d4b700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.51:6790/0 conn(0x7fd5f008fa70 legacy=0x7fd5f00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.058+0000 7fd5effff700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.51:6789/0 conn(0x7fd5f0092bf0 legacy=0x7fd5f00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770164842 0 0) 0x7fd5f0091010 con 0x7fd5f008fa70 2021-02-06T22:53:04.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d4003230 con 0x7fd5f008fa70 2021-02-06T22:53:04.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499323315 0 0) 0x7fd5f0095440 con 0x7fd5f0092bf0 2021-02-06T22:53:04.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0091010 con 0x7fd5f0092bf0 2021-02-06T22:53:04.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5f554c700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.106:6789/0 conn(0x7fd5f012ce00 legacy=0x7fd5f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3768581882 0 0) 0x7fd5d4003230 con 0x7fd5f008fa70 2021-02-06T22:53:04.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.106:6789/0 conn(0x7fd5f012ce00 legacy=0x7fd5f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.51:6789/0 conn(0x7fd5f0092bf0 legacy=0x7fd5f00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f00912b0 con 0x7fd5f008fa70 2021-02-06T22:53:04.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5e4001930 con 0x7fd5f008fa70 2021-02-06T22:53:04.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd5e4001c40 con 0x7fd5f008fa70 2021-02-06T22:53:04.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5ef7fe700 1 -- 172.21.15.51:0/4250800356 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5e4004690 con 0x7fd5f008fa70 2021-02-06T22:53:04.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.059+0000 7fd5f6faf700 1 -- 172.21.15.51:0/4250800356 >> v1:172.21.15.51:6790/0 conn(0x7fd5f008fa70 legacy=0x7fd5f00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 -- 172.21.15.51:0/4250800356 shutdown_connections 2021-02-06T22:53:04.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 -- 172.21.15.51:0/4250800356 >> 172.21.15.51:0/4250800356 conn(0x7fd5f0096860 msgr2=0x7fd5f0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:04.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 -- 172.21.15.51:0/4250800356 shutdown_connections 2021-02-06T22:53:04.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 -- 172.21.15.51:0/4250800356 wait complete. 2021-02-06T22:53:04.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 librados: starting msgr at 2021-02-06T22:53:04.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 librados: starting objecter 2021-02-06T22:53:04.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.060+0000 7fd5f6faf700 1 Processor -- start 2021-02-06T22:53:04.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 -- start start 2021-02-06T22:53:04.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 librados: setting wanted keys 2021-02-06T22:53:04.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 librados: calling monclient init 2021-02-06T22:53:04.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0090bf0 con 0x7fd5f008fa70 2021-02-06T22:53:04.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f012a380 con 0x7fd5f012ce00 2021-02-06T22:53:04.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f6faf700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f012a620 con 0x7fd5f0092bf0 2021-02-06T22:53:04.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f4d4b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd5f008fa70 0x7fd5f012bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59738/0 (socket says 172.21.15.51:59738) 2021-02-06T22:53:04.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.061+0000 7fd5f4d4b700 1 -- 172.21.15.51:0/3205026561 learned_addr learned my addr 172.21.15.51:0/3205026561 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:04.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5f4d4b700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.51:6789/0 conn(0x7fd5f008fa70 legacy=0x7fd5f012bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 10 client.?.objecter ms_handle_connect 0x7fd5f008fa70 2021-02-06T22:53:04.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:04.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 10 client.?.objecter ms_handle_connect 0x7fd5f0092bf0 2021-02-06T22:53:04.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:04.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5effff700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.51:6790/0 conn(0x7fd5f0092bf0 legacy=0x7fd5f013a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534901359 0 0) 0x7fd5f0090bf0 con 0x7fd5f008fa70 2021-02-06T22:53:04.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d0004bd0 con 0x7fd5f008fa70 2021-02-06T22:53:04.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.063+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513589243 0 0) 0x7fd5f012a620 con 0x7fd5f0092bf0 2021-02-06T22:53:04.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0090bf0 con 0x7fd5f0092bf0 2021-02-06T22:53:04.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 10 client.?.objecter ms_handle_connect 0x7fd5f012ce00 2021-02-06T22:53:04.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:04.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5f554c700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6789/0 conn(0x7fd5f012ce00 legacy=0x7fd5f013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:04.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2043923920 0 0) 0x7fd5d0004bd0 con 0x7fd5f008fa70 2021-02-06T22:53:04.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5f012a620 con 0x7fd5f008fa70 2021-02-06T22:53:04.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5e40018f0 con 0x7fd5f008fa70 2021-02-06T22:53:04.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1692154584 0 0) 0x7fd5f0090bf0 con 0x7fd5f0092bf0 2021-02-06T22:53:04.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd5d0004bd0 con 0x7fd5f0092bf0 2021-02-06T22:53:04.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5dc001b90 con 0x7fd5f0092bf0 2021-02-06T22:53:04.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650501326 0 0) 0x7fd5f012a380 con 0x7fd5f012ce00 2021-02-06T22:53:04.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5f0090bf0 con 0x7fd5f012ce00 2021-02-06T22:53:04.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 206012058 0 0) 0x7fd5f012a620 con 0x7fd5f008fa70 2021-02-06T22:53:04.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.51:6790/0 conn(0x7fd5f0092bf0 legacy=0x7fd5f013a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6789/0 conn(0x7fd5f012ce00 legacy=0x7fd5f013dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f012a8c0 con 0x7fd5f008fa70 2021-02-06T22:53:04.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f012c460 con 0x7fd5f008fa70 2021-02-06T22:53:04.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5f6faf700 10 client.4377.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:04.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f0127c20 con 0x7fd5f008fa70 2021-02-06T22:53:04.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5f6faf700 1 librados: init done 2021-02-06T22:53:04.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd5e4001560 con 0x7fd5f008fa70 2021-02-06T22:53:04.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.064+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd5e4004f20 con 0x7fd5f008fa70 2021-02-06T22:53:04.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fd5e4005080 con 0x7fd5f008fa70 2021-02-06T22:53:04.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fd5e4039690 con 0x7fd5f008fa70 2021-02-06T22:53:04.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 10 client.4377.objecter ms_dispatch 0x7fd5f0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:04.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 3 client.4377.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:04.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 3 client.4377.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:04.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 20 client.4377.objecter dump_active .. 0 homeless 2021-02-06T22:53:04.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c8004d60 con 0x7fd5f008fa70 2021-02-06T22:53:04.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5effff700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6812/33219 conn(0x7fd5d0030740 legacy=0x7fd5d0032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-06T22:53:04.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5effff700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6812/33219 conn(0x7fd5d0030740 legacy=0x7fd5d0032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:53:04.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5effff700 1 --1- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6812/33219 conn(0x7fd5d0030740 0x7fd5d0032c00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-06T22:53:04.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5effff700 1 --1- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6812/33219 conn(0x7fd5d0030740 0x7fd5d0032c00 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-06T22:53:04.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.065+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.106:6812/33219 conn(0x7fd5d0030740 legacy=0x7fd5d0032c00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:53:04.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.069+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd5e40125e0 con 0x7fd5f008fa70 2021-02-06T22:53:04.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.318+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd5c80059b0 con 0x7fd5f008fa70 2021-02-06T22:53:04.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.319+0000 7fd5ecff9700 1 -- 172.21.15.51:0/3205026561 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fd5e40125e0 con 0x7fd5f008fa70 2021-02-06T22:53:04.319 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:04.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 10 librados: watch_flush enter 2021-02-06T22:53:04.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 10 librados: watch_flush exit 2021-02-06T22:53:04.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 20 client.4377.objecter shutdown clearing up homeless session... 2021-02-06T22:53:04.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 10 client.4377.objecter successfully canceled tick 2021-02-06T22:53:04.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 >> v1:172.21.15.51:6789/0 conn(0x7fd5f008fa70 legacy=0x7fd5f012bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:04.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 shutdown_connections 2021-02-06T22:53:04.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 >> 172.21.15.51:0/3205026561 conn(0x7fd5f0096860 msgr2=0x7fd5f0093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:04.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 shutdown_connections 2021-02-06T22:53:04.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 -- 172.21.15.51:0/3205026561 wait complete. 2021-02-06T22:53:04.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:04.320+0000 7fd5f6faf700 1 librados: shutdown 2021-02-06T22:53:04.331 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:07.332 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:07.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.468+0000 7f330c112700 1 Processor -- start 2021-02-06T22:53:07.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.468+0000 7f330c112700 1 -- start start 2021-02-06T22:53:07.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.469+0000 7f330c112700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304095440 con 0x7f3304092bf0 2021-02-06T22:53:07.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.469+0000 7f330c112700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040907b0 con 0x7f330412ce00 2021-02-06T22:53:07.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.469+0000 7f330c112700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304091010 con 0x7f330408fa70 2021-02-06T22:53:07.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.469+0000 7f33096ad700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 0x7f33040930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59748/0 (socket says 172.21.15.51:59748) 2021-02-06T22:53:07.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.469+0000 7f33096ad700 1 -- 172.21.15.51:0/1791959548 learned_addr learned my addr 172.21.15.51:0/1791959548 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:07.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f33096ad700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 legacy=0x7f33040930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f3309eae700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.51:6790/0 conn(0x7f330408fa70 legacy=0x7f33040921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f330a6af700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.106:6789/0 conn(0x7f330412ce00 legacy=0x7f330412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.473 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948779498 0 0) 0x7f3304095440 con 0x7f3304092bf0 2021-02-06T22:53:07.473 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32ec003230 con 0x7f3304092bf0 2021-02-06T22:53:07.474 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613904892 0 0) 0x7f3304091010 con 0x7f330408fa70 2021-02-06T22:53:07.474 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.471+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3304095440 con 0x7f330408fa70 2021-02-06T22:53:07.474 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245270119 0 0) 0x7f33040907b0 con 0x7f330412ce00 2021-02-06T22:53:07.475 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3304091010 con 0x7f330412ce00 2021-02-06T22:53:07.475 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3346614277 0 0) 0x7f3304095440 con 0x7f330408fa70 2021-02-06T22:53:07.475 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.106:6789/0 conn(0x7f330412ce00 legacy=0x7f330412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.475 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 legacy=0x7f33040930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.475 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040912b0 con 0x7f330408fa70 2021-02-06T22:53:07.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f32f4001a40 con 0x7f330408fa70 2021-02-06T22:53:07.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f32f4001d20 con 0x7f330408fa70 2021-02-06T22:53:07.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f3308eac700 1 -- 172.21.15.51:0/1791959548 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f32f4002060 con 0x7f330408fa70 2021-02-06T22:53:07.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f330c112700 1 -- 172.21.15.51:0/1791959548 >> v1:172.21.15.51:6790/0 conn(0x7f330408fa70 legacy=0x7f33040921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f330c112700 1 -- 172.21.15.51:0/1791959548 shutdown_connections 2021-02-06T22:53:07.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f330c112700 1 -- 172.21.15.51:0/1791959548 >> 172.21.15.51:0/1791959548 conn(0x7f3304096860 msgr2=0x7f3304099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:07.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f330c112700 1 -- 172.21.15.51:0/1791959548 shutdown_connections 2021-02-06T22:53:07.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.472+0000 7f330c112700 1 -- 172.21.15.51:0/1791959548 wait complete. 2021-02-06T22:53:07.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 librados: starting msgr at 2021-02-06T22:53:07.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 librados: starting objecter 2021-02-06T22:53:07.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 Processor -- start 2021-02-06T22:53:07.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 -- start start 2021-02-06T22:53:07.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 librados: setting wanted keys 2021-02-06T22:53:07.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.473+0000 7f330c112700 1 librados: calling monclient init 2021-02-06T22:53:07.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.474+0000 7f330c112700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330412b670 con 0x7f3304092bf0 2021-02-06T22:53:07.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.474+0000 7f330c112700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304090bf0 con 0x7f330408fa70 2021-02-06T22:53:07.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.474+0000 7f330c112700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304097eb0 con 0x7f330412ce00 2021-02-06T22:53:07.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.474+0000 7f33096ad700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 0x7f330413e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59754/0 (socket says 172.21.15.51:59754) 2021-02-06T22:53:07.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.474+0000 7f33096ad700 1 -- 172.21.15.51:0/2299853828 learned_addr learned my addr 172.21.15.51:0/2299853828 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:07.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f33096ad700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 legacy=0x7f330413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f330a6af700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.51:6790/0 conn(0x7f330412ce00 legacy=0x7f3304142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter ms_handle_connect 0x7f3304092bf0 2021-02-06T22:53:07.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:07.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter ms_handle_connect 0x7f330412ce00 2021-02-06T22:53:07.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:07.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter ms_handle_connect 0x7f330408fa70 2021-02-06T22:53:07.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:07.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f3309eae700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.106:6789/0 conn(0x7f330408fa70 legacy=0x7f33041287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:07.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647143249 0 0) 0x7f330412b670 con 0x7f3304092bf0 2021-02-06T22:53:07.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e4004bd0 con 0x7f3304092bf0 2021-02-06T22:53:07.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171578528 0 0) 0x7f3304097eb0 con 0x7f330412ce00 2021-02-06T22:53:07.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f330412b670 con 0x7f330412ce00 2021-02-06T22:53:07.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435674562 0 0) 0x7f3304090bf0 con 0x7f330408fa70 2021-02-06T22:53:07.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3304097eb0 con 0x7f330408fa70 2021-02-06T22:53:07.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 256173522 0 0) 0x7f32e4004bd0 con 0x7f3304092bf0 2021-02-06T22:53:07.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3304090bf0 con 0x7f3304092bf0 2021-02-06T22:53:07.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3300001c70 con 0x7f3304092bf0 2021-02-06T22:53:07.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.476+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2993037111 0 0) 0x7f330412b670 con 0x7f330412ce00 2021-02-06T22:53:07.487 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f32e4004bd0 con 0x7f330412ce00 2021-02-06T22:53:07.487 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f32fc001f60 con 0x7f330412ce00 2021-02-06T22:53:07.487 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 135925181 0 0) 0x7f3304090bf0 con 0x7f3304092bf0 2021-02-06T22:53:07.487 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.51:6790/0 conn(0x7f330412ce00 legacy=0x7f3304142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.106:6789/0 conn(0x7f330408fa70 legacy=0x7f33041287b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304129490 con 0x7f3304092bf0 2021-02-06T22:53:07.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3304128ec0 con 0x7f3304092bf0 2021-02-06T22:53:07.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3300004860 con 0x7f3304092bf0 2021-02-06T22:53:07.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3300004b70 con 0x7f3304092bf0 2021-02-06T22:53:07.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f330c112700 10 client.4383.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:07.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f330412a0c0 con 0x7f3304092bf0 2021-02-06T22:53:07.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f330c112700 1 librados: init done 2021-02-06T22:53:07.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.477+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3300004d10 con 0x7f3304092bf0 2021-02-06T22:53:07.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3300039520 con 0x7f3304092bf0 2021-02-06T22:53:07.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f32f1ffb700 10 client.4383.objecter ms_dispatch 0x7f3304001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:07.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f32f1ffb700 3 client.4383.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:07.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f32f1ffb700 3 client.4383.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:07.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f32f1ffb700 20 client.4383.objecter dump_active .. 0 homeless 2021-02-06T22:53:07.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.478+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3304128270 con 0x7f3304092bf0 2021-02-06T22:53:07.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.480+0000 7f32f1ffb700 10 client.4383.objecter ms_handle_connect 0x7f32e4030460 2021-02-06T22:53:07.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.482+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f3300012410 con 0x7f3304092bf0 2021-02-06T22:53:07.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.732+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f330412ab60 con 0x7f3304092bf0 2021-02-06T22:53:07.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.732+0000 7f32f1ffb700 1 -- 172.21.15.51:0/2299853828 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f3300012000 con 0x7f3304092bf0 2021-02-06T22:53:07.733 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:07.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.733+0000 7f330c112700 10 librados: watch_flush enter 2021-02-06T22:53:07.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.733+0000 7f330c112700 10 librados: watch_flush exit 2021-02-06T22:53:07.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.733+0000 7f330c112700 20 client.4383.objecter shutdown clearing up homeless session... 2021-02-06T22:53:07.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.733+0000 7f330c112700 10 client.4383.objecter successfully canceled tick 2021-02-06T22:53:07.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.106:6812/33219 conn(0x7f32e4030460 legacy=0x7f32e4032920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 >> v1:172.21.15.51:6789/0 conn(0x7f3304092bf0 legacy=0x7f330413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:07.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 shutdown_connections 2021-02-06T22:53:07.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 >> 172.21.15.51:0/2299853828 conn(0x7f3304096860 msgr2=0x7f330412f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:07.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 shutdown_connections 2021-02-06T22:53:07.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 -- 172.21.15.51:0/2299853828 wait complete. 2021-02-06T22:53:07.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:07.734+0000 7f330c112700 1 librados: shutdown 2021-02-06T22:53:07.744 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:10.745 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:10.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1ea20d1700 1 Processor -- start 2021-02-06T22:53:10.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1ea20d1700 1 -- start start 2021-02-06T22:53:10.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1ea20d1700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c0915d0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1ea20d1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c091ac0 con 0x7f1e9c0999a0 2021-02-06T22:53:10.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1ea20d1700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c091d60 con 0x7f1e9c0629e0 2021-02-06T22:53:10.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1e9bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 0x7f1e9c12fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59760/0 (socket says 172.21.15.51:59760) 2021-02-06T22:53:10.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1e9bfff700 1 -- 172.21.15.51:0/3607932630 learned_addr learned my addr 172.21.15.51:0/3607932630 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:10.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.882+0000 7f1e9affd700 1 --1- 172.21.15.51:0/3607932630 >> v1:172.21.15.51:6790/0 conn(0x7f1e9c0629e0 0x7f1e9c090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60106/0 (socket says 172.21.15.51:60106) 2021-02-06T22:53:10.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.884+0000 7f1e9bfff700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 legacy=0x7f1e9c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9affd700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.51:6790/0 conn(0x7f1e9c0629e0 legacy=0x7f1e9c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429370108 0 0) 0x7f1e9c0915d0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e88003230 con 0x7f1e9c0928d0 2021-02-06T22:53:10.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490059326 0 0) 0x7f1e9c091d60 con 0x7f1e9c0629e0 2021-02-06T22:53:10.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e9c0915d0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9b7fe700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.106:6789/0 conn(0x7f1e9c0999a0 legacy=0x7f1e9c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2581311306 0 0) 0x7f1e88003230 con 0x7f1e9c0928d0 2021-02-06T22:53:10.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.51:6790/0 conn(0x7f1e9c0629e0 legacy=0x7f1e9c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:10.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.106:6789/0 conn(0x7f1e9c0999a0 legacy=0x7f1e9c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:10.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c092000 con 0x7f1e9c0928d0 2021-02-06T22:53:10.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e94001cb0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3084805736 0 0) 0x7f1e9c0915d0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e8c0018b0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1e94001fc0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.885+0000 7f1e9a7fc700 1 -- 172.21.15.51:0/3607932630 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e94004ad0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.886+0000 7f1ea20d1700 1 -- 172.21.15.51:0/3607932630 >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 legacy=0x7f1e9c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:10.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.886+0000 7f1ea20d1700 1 -- 172.21.15.51:0/3607932630 shutdown_connections 2021-02-06T22:53:10.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.886+0000 7f1ea20d1700 1 -- 172.21.15.51:0/3607932630 >> 172.21.15.51:0/3607932630 conn(0x7f1e9c096860 msgr2=0x7f1e9c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:10.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.886+0000 7f1ea20d1700 1 -- 172.21.15.51:0/3607932630 shutdown_connections 2021-02-06T22:53:10.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.886+0000 7f1ea20d1700 1 -- 172.21.15.51:0/3607932630 wait complete. 2021-02-06T22:53:10.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 librados: starting msgr at 2021-02-06T22:53:10.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 librados: starting objecter 2021-02-06T22:53:10.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 Processor -- start 2021-02-06T22:53:10.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 -- start start 2021-02-06T22:53:10.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 librados: setting wanted keys 2021-02-06T22:53:10.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 librados: calling monclient init 2021-02-06T22:53:10.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c130a50 con 0x7f1e9c0928d0 2021-02-06T22:53:10.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c1187f0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1ea20d1700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9c118a90 con 0x7f1e9c0999a0 2021-02-06T22:53:10.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.887+0000 7f1e9affd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 0x7f1e9c130340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59768/0 (socket says 172.21.15.51:59768) 2021-02-06T22:53:10.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.888+0000 7f1e9affd700 1 -- 172.21.15.51:0/2752772840 learned_addr learned my addr 172.21.15.51:0/2752772840 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:10.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e9affd700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 legacy=0x7f1e9c130340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e9bfff700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.51:6790/0 conn(0x7f1e9c0999a0 legacy=0x7f1e9c13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter ms_handle_connect 0x7f1e9c0928d0 2021-02-06T22:53:10.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:10.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter ms_handle_connect 0x7f1e9c0999a0 2021-02-06T22:53:10.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:10.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter ms_handle_connect 0x7f1e9c0629e0 2021-02-06T22:53:10.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:10.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e9b7fe700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.106:6789/0 conn(0x7f1e9c0629e0 legacy=0x7f1e9c137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:10.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403340957 0 0) 0x7f1e9c130a50 con 0x7f1e9c0928d0 2021-02-06T22:53:10.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e7c004bd0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201929762 0 0) 0x7f1e9c118a90 con 0x7f1e9c0999a0 2021-02-06T22:53:10.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e9c130a50 con 0x7f1e9c0999a0 2021-02-06T22:53:10.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264408013 0 0) 0x7f1e9c1187f0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e9c118a90 con 0x7f1e9c0629e0 2021-02-06T22:53:10.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3753301126 0 0) 0x7f1e7c004bd0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e9c1187f0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e8c001be0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1309908706 0 0) 0x7f1e9c130a50 con 0x7f1e9c0999a0 2021-02-06T22:53:10.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e7c004bd0 con 0x7f1e9c0999a0 2021-02-06T22:53:10.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e94001c70 con 0x7f1e9c0999a0 2021-02-06T22:53:10.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2124563238 0 0) 0x7f1e9c118a90 con 0x7f1e9c0629e0 2021-02-06T22:53:10.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1e9c130a50 con 0x7f1e9c0629e0 2021-02-06T22:53:10.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e90001ba0 con 0x7f1e9c0629e0 2021-02-06T22:53:10.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 420447150 0 0) 0x7f1e9c1187f0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.51:6790/0 conn(0x7f1e9c0999a0 legacy=0x7f1e9c13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:10.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.106:6789/0 conn(0x7f1e9c0629e0 legacy=0x7f1e9c137670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:10.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c118d30 con 0x7f1e9c0928d0 2021-02-06T22:53:10.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9c116bc0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1ea20d1700 10 client.4389.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:10.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9c138360 con 0x7f1e9c0928d0 2021-02-06T22:53:10.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.890+0000 7f1ea20d1700 1 librados: init done 2021-02-06T22:53:10.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.891+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1e8c004860 con 0x7f1e9c0928d0 2021-02-06T22:53:10.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.891+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1e8c004b70 con 0x7f1e9c0928d0 2021-02-06T22:53:10.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.891+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f1e8c004cd0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.891+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f1e8c0394d0 con 0x7f1e9c0928d0 2021-02-06T22:53:10.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.892+0000 7f1e837fe700 10 client.4389.objecter ms_dispatch 0x7f1e9c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:10.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.892+0000 7f1e837fe700 3 client.4389.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:10.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.892+0000 7f1e837fe700 3 client.4389.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:10.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.892+0000 7f1e837fe700 20 client.4389.objecter dump_active .. 0 homeless 2021-02-06T22:53:10.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.892+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74004d60 con 0x7f1e9c0928d0 2021-02-06T22:53:10.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.894+0000 7f1e837fe700 10 client.4389.objecter ms_handle_connect 0x7f1e7c030800 2021-02-06T22:53:10.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:10.896+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f1e8c012360 con 0x7f1e9c0928d0 2021-02-06T22:53:11.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.142+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1e740059b0 con 0x7f1e9c0928d0 2021-02-06T22:53:11.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.143+0000 7f1e837fe700 1 -- 172.21.15.51:0/2752772840 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f1e8c011f50 con 0x7f1e9c0928d0 2021-02-06T22:53:11.143 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:11.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 10 librados: watch_flush enter 2021-02-06T22:53:11.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 10 librados: watch_flush exit 2021-02-06T22:53:11.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 20 client.4389.objecter shutdown clearing up homeless session... 2021-02-06T22:53:11.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 10 client.4389.objecter successfully canceled tick 2021-02-06T22:53:11.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.106:6812/33219 conn(0x7f1e7c030800 legacy=0x7f1e7c032cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:11.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 >> v1:172.21.15.51:6789/0 conn(0x7f1e9c0928d0 legacy=0x7f1e9c130340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:11.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 shutdown_connections 2021-02-06T22:53:11.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 >> 172.21.15.51:0/2752772840 conn(0x7f1e9c096860 msgr2=0x7f1e9c067760 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:11.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 shutdown_connections 2021-02-06T22:53:11.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 -- 172.21.15.51:0/2752772840 wait complete. 2021-02-06T22:53:11.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:11.144+0000 7f1ea20d1700 1 librados: shutdown 2021-02-06T22:53:11.155 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:14.156 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:14.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f4855c61700 1 Processor -- start 2021-02-06T22:53:14.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f4855c61700 1 -- start start 2021-02-06T22:53:14.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f4855c61700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4850095440 con 0x7f485008fa70 2021-02-06T22:53:14.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f4855c61700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48500907b0 con 0x7f485012ce00 2021-02-06T22:53:14.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f4855c61700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4850091010 con 0x7f4850092bf0 2021-02-06T22:53:14.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f484f7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f485008fa70 0x7f48500921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59774/0 (socket says 172.21.15.51:59774) 2021-02-06T22:53:14.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f484f7fe700 1 -- 172.21.15.51:0/2143731980 learned_addr learned my addr 172.21.15.51:0/2143731980 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:14.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.293+0000 7f484effd700 1 --1- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6790/0 conn(0x7f4850092bf0 0x7f48500930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60120/0 (socket says 172.21.15.51:60120) 2021-02-06T22:53:14.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.295+0000 7f484f7fe700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6789/0 conn(0x7f485008fa70 legacy=0x7f48500921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.295+0000 7f484effd700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6790/0 conn(0x7f4850092bf0 legacy=0x7f48500930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170868663 0 0) 0x7f4850095440 con 0x7f485008fa70 2021-02-06T22:53:14.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f483c003230 con 0x7f485008fa70 2021-02-06T22:53:14.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232693448 0 0) 0x7f4850091010 con 0x7f4850092bf0 2021-02-06T22:53:14.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4850095440 con 0x7f4850092bf0 2021-02-06T22:53:14.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484ffff700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.106:6789/0 conn(0x7f485012ce00 legacy=0x7f485012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 795127013 0 0) 0x7f4850095440 con 0x7f4850092bf0 2021-02-06T22:53:14.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.106:6789/0 conn(0x7f485012ce00 legacy=0x7f485012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6789/0 conn(0x7f485008fa70 legacy=0x7f48500921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48500912b0 con 0x7f4850092bf0 2021-02-06T22:53:14.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4840001930 con 0x7f4850092bf0 2021-02-06T22:53:14.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484effd700 1 --1- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6790/0 conn(0x7f4850092bf0 0x7f48500930a0 :-1 s=OPENED pgs=132 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f4840004690 mon_map magic: 0 v1 2021-02-06T22:53:14.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.296+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4840001c40 con 0x7f4850092bf0 2021-02-06T22:53:14.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 -- 172.21.15.51:0/2143731980 >> v1:172.21.15.51:6790/0 conn(0x7f4850092bf0 legacy=0x7f48500930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f484e7fc700 1 -- 172.21.15.51:0/2143731980 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4840004690 con 0x7f4850092bf0 2021-02-06T22:53:14.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 -- 172.21.15.51:0/2143731980 shutdown_connections 2021-02-06T22:53:14.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 -- 172.21.15.51:0/2143731980 >> 172.21.15.51:0/2143731980 conn(0x7f4850096860 msgr2=0x7f4850099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:14.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 -- 172.21.15.51:0/2143731980 shutdown_connections 2021-02-06T22:53:14.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 -- 172.21.15.51:0/2143731980 wait complete. 2021-02-06T22:53:14.305 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 librados: starting msgr at 2021-02-06T22:53:14.305 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.297+0000 7f4855c61700 1 librados: starting objecter 2021-02-06T22:53:14.306 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 Processor -- start 2021-02-06T22:53:14.306 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 -- start start 2021-02-06T22:53:14.306 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 librados: setting wanted keys 2021-02-06T22:53:14.306 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 librados: calling monclient init 2021-02-06T22:53:14.306 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4850112400 con 0x7f4850092bf0 2021-02-06T22:53:14.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4850114dc0 con 0x7f485008fa70 2021-02-06T22:53:14.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f4855c61700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4850115060 con 0x7f485012ce00 2021-02-06T22:53:14.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f484effd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4850092bf0 0x7f4850111cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59782/0 (socket says 172.21.15.51:59782) 2021-02-06T22:53:14.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.298+0000 7f484effd700 1 -- 172.21.15.51:0/4062273077 learned_addr learned my addr 172.21.15.51:0/4062273077 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:14.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.300+0000 7f484effd700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.51:6789/0 conn(0x7f4850092bf0 legacy=0x7f4850111cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.300+0000 7f48377fe700 10 client.?.objecter ms_handle_connect 0x7f4850092bf0 2021-02-06T22:53:14.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.300+0000 7f48377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:14.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 10 client.?.objecter ms_handle_connect 0x7f485012ce00 2021-02-06T22:53:14.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:14.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f484ffff700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.51:6790/0 conn(0x7f485012ce00 legacy=0x7f485013ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503576060 0 0) 0x7f4850112400 con 0x7f4850092bf0 2021-02-06T22:53:14.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4830004bd0 con 0x7f4850092bf0 2021-02-06T22:53:14.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 10 client.?.objecter ms_handle_connect 0x7f485008fa70 2021-02-06T22:53:14.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:14.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f484f7fe700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.106:6789/0 conn(0x7f485008fa70 legacy=0x7f48501115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:14.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516101923 0 0) 0x7f4850115060 con 0x7f485012ce00 2021-02-06T22:53:14.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4850112400 con 0x7f485012ce00 2021-02-06T22:53:14.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656639176 0 0) 0x7f4850114dc0 con 0x7f485008fa70 2021-02-06T22:53:14.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4850115060 con 0x7f485008fa70 2021-02-06T22:53:14.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1651717424 0 0) 0x7f4830004bd0 con 0x7f4850092bf0 2021-02-06T22:53:14.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4850114dc0 con 0x7f4850092bf0 2021-02-06T22:53:14.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f48400012e0 con 0x7f4850092bf0 2021-02-06T22:53:14.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2258914306 0 0) 0x7f4850112400 con 0x7f485012ce00 2021-02-06T22:53:14.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4830004bd0 con 0x7f485012ce00 2021-02-06T22:53:14.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4848001e20 con 0x7f485012ce00 2021-02-06T22:53:14.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2626810743 0 0) 0x7f4850114dc0 con 0x7f4850092bf0 2021-02-06T22:53:14.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.51:6790/0 conn(0x7f485012ce00 legacy=0x7f485013ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.106:6789/0 conn(0x7f485008fa70 legacy=0x7f48501115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850115300 con 0x7f4850092bf0 2021-02-06T22:53:14.313 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4850113190 con 0x7f4850092bf0 2021-02-06T22:53:14.313 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f4855c61700 10 client.4395.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:14.313 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4850113ff0 con 0x7f4850092bf0 2021-02-06T22:53:14.313 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f4855c61700 1 librados: init done 2021-02-06T22:53:14.313 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4840004ef0 con 0x7f4850092bf0 2021-02-06T22:53:14.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.301+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4840005060 con 0x7f4850092bf0 2021-02-06T22:53:14.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f484000d820 con 0x7f4850092bf0 2021-02-06T22:53:14.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f48400397a0 con 0x7f4850092bf0 2021-02-06T22:53:14.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 10 client.4395.objecter ms_dispatch 0x7f4850001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:14.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 3 client.4395.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:14.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 3 client.4395.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:14.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f48377fe700 20 client.4395.objecter dump_active .. 0 homeless 2021-02-06T22:53:14.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.302+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4828004d60 con 0x7f4850092bf0 2021-02-06T22:53:14.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.305+0000 7f48377fe700 10 client.4395.objecter ms_handle_connect 0x7f4830030430 2021-02-06T22:53:14.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.306+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4840012700 con 0x7f4850092bf0 2021-02-06T22:53:14.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.563+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f48280059b0 con 0x7f4850092bf0 2021-02-06T22:53:14.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.564+0000 7f48377fe700 1 -- 172.21.15.51:0/4062273077 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f48400122f0 con 0x7f4850092bf0 2021-02-06T22:53:14.563 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:14.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 10 librados: watch_flush enter 2021-02-06T22:53:14.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 10 librados: watch_flush exit 2021-02-06T22:53:14.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 20 client.4395.objecter shutdown clearing up homeless session... 2021-02-06T22:53:14.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 10 client.4395.objecter successfully canceled tick 2021-02-06T22:53:14.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.106:6812/33219 conn(0x7f4830030430 legacy=0x7f48300328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 >> v1:172.21.15.51:6789/0 conn(0x7f4850092bf0 legacy=0x7f4850111cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:14.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 shutdown_connections 2021-02-06T22:53:14.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 >> 172.21.15.51:0/4062273077 conn(0x7f4850096860 msgr2=0x7f485012eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:14.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 shutdown_connections 2021-02-06T22:53:14.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 -- 172.21.15.51:0/4062273077 wait complete. 2021-02-06T22:53:14.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:14.565+0000 7f4855c61700 1 librados: shutdown 2021-02-06T22:53:14.575 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:17.577 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:17.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.712+0000 7fc72f2df700 1 Processor -- start 2021-02-06T22:53:17.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72f2df700 1 -- start start 2021-02-06T22:53:17.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72f2df700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7280915d0 con 0x7fc7280928d0 2021-02-06T22:53:17.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72f2df700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728091ac0 con 0x7fc7280999a0 2021-02-06T22:53:17.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72f2df700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728091d60 con 0x7fc7280629e0 2021-02-06T22:53:17.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72d87c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fc7280928d0 0x7fc72812fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59788/0 (socket says 172.21.15.51:59788) 2021-02-06T22:53:17.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72c87a700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fc7280629e0 0x7fc728090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60130/0 (socket says 172.21.15.51:60130) 2021-02-06T22:53:17.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.713+0000 7fc72d87c700 1 -- 172.21.15.51:0/567455603 learned_addr learned my addr 172.21.15.51:0/567455603 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:17.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.715+0000 7fc72c87a700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.51:6790/0 conn(0x7fc7280629e0 legacy=0x7fc728090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc72d87c700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.51:6789/0 conn(0x7fc7280928d0 legacy=0x7fc72812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550581379 0 0) 0x7fc728091d60 con 0x7fc7280629e0 2021-02-06T22:53:17.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc710003230 con 0x7fc7280629e0 2021-02-06T22:53:17.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122359365 0 0) 0x7fc7280915d0 con 0x7fc7280928d0 2021-02-06T22:53:17.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc728091d60 con 0x7fc7280928d0 2021-02-06T22:53:17.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc72d07b700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.106:6789/0 conn(0x7fc7280999a0 legacy=0x7fc7280907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 534822775 0 0) 0x7fc710003230 con 0x7fc7280629e0 2021-02-06T22:53:17.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.106:6789/0 conn(0x7fc7280999a0 legacy=0x7fc7280907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.51:6789/0 conn(0x7fc7280928d0 legacy=0x7fc72812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728092000 con 0x7fc7280629e0 2021-02-06T22:53:17.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc724001930 con 0x7fc7280629e0 2021-02-06T22:53:17.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc72c87a700 1 --1- 172.21.15.51:0/567455603 >> v1:172.21.15.51:6790/0 conn(0x7fc7280629e0 0x7fc728090ec0 :-1 s=OPENED pgs=134 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fc724004690 mon_map magic: 0 v1 2021-02-06T22:53:17.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.716+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc724001c40 con 0x7fc7280629e0 2021-02-06T22:53:17.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 -- 172.21.15.51:0/567455603 >> v1:172.21.15.51:6790/0 conn(0x7fc7280629e0 legacy=0x7fc728090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc71bfff700 1 -- 172.21.15.51:0/567455603 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc724004690 con 0x7fc7280629e0 2021-02-06T22:53:17.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 -- 172.21.15.51:0/567455603 shutdown_connections 2021-02-06T22:53:17.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 -- 172.21.15.51:0/567455603 >> 172.21.15.51:0/567455603 conn(0x7fc728096860 msgr2=0x7fc728099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:17.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 -- 172.21.15.51:0/567455603 shutdown_connections 2021-02-06T22:53:17.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 -- 172.21.15.51:0/567455603 wait complete. 2021-02-06T22:53:17.723 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 librados: starting msgr at 2021-02-06T22:53:17.723 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.717+0000 7fc72f2df700 1 librados: starting objecter 2021-02-06T22:53:17.724 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 Processor -- start 2021-02-06T22:53:17.724 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 -- start start 2021-02-06T22:53:17.724 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 librados: setting wanted keys 2021-02-06T22:53:17.724 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 librados: calling monclient init 2021-02-06T22:53:17.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728130b00 con 0x7fc7280629e0 2021-02-06T22:53:17.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728130da0 con 0x7fc7280928d0 2021-02-06T22:53:17.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72f2df700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc728131040 con 0x7fc7280999a0 2021-02-06T22:53:17.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72d07b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fc7280629e0 0x7fc72812e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59794/0 (socket says 172.21.15.51:59794) 2021-02-06T22:53:17.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.718+0000 7fc72d07b700 1 -- 172.21.15.51:0/2009494866 learned_addr learned my addr 172.21.15.51:0/2009494866 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:17.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.720+0000 7fc72d87c700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.51:6790/0 conn(0x7fc7280999a0 legacy=0x7fc72813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.720+0000 7fc7197fa700 10 client.?.objecter ms_handle_connect 0x7fc7280999a0 2021-02-06T22:53:17.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.720+0000 7fc7197fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:17.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 10 client.?.objecter ms_handle_connect 0x7fc7280629e0 2021-02-06T22:53:17.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.720+0000 7fc72d07b700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.51:6789/0 conn(0x7fc7280629e0 legacy=0x7fc72812e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:17.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801959339 0 0) 0x7fc728131040 con 0x7fc7280999a0 2021-02-06T22:53:17.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc708004bd0 con 0x7fc7280999a0 2021-02-06T22:53:17.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260967759 0 0) 0x7fc728130b00 con 0x7fc7280629e0 2021-02-06T22:53:17.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc728131040 con 0x7fc7280629e0 2021-02-06T22:53:17.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 10 client.?.objecter ms_handle_connect 0x7fc7280928d0 2021-02-06T22:53:17.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:17.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc72c87a700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.106:6789/0 conn(0x7fc7280928d0 legacy=0x7fc72812eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:17.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2078250590 0 0) 0x7fc728131040 con 0x7fc7280629e0 2021-02-06T22:53:17.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc728130b00 con 0x7fc7280629e0 2021-02-06T22:53:17.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc71c001c00 con 0x7fc7280629e0 2021-02-06T22:53:17.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 337924740 0 0) 0x7fc708004bd0 con 0x7fc7280999a0 2021-02-06T22:53:17.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc728131040 con 0x7fc7280999a0 2021-02-06T22:53:17.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc720001fe0 con 0x7fc7280999a0 2021-02-06T22:53:17.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38378894 0 0) 0x7fc728130da0 con 0x7fc7280928d0 2021-02-06T22:53:17.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc708004bd0 con 0x7fc7280928d0 2021-02-06T22:53:17.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3444936481 0 0) 0x7fc728130b00 con 0x7fc7280629e0 2021-02-06T22:53:17.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.51:6790/0 conn(0x7fc7280999a0 legacy=0x7fc72813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.106:6789/0 conn(0x7fc7280928d0 legacy=0x7fc72812eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7280947d0 con 0x7fc7280629e0 2021-02-06T22:53:17.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72812fb00 con 0x7fc7280629e0 2021-02-06T22:53:17.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc72f2df700 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:17.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc728127280 con 0x7fc7280629e0 2021-02-06T22:53:17.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc72f2df700 1 librados: init done 2021-02-06T22:53:17.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fc71c0022b0 con 0x7fc7280629e0 2021-02-06T22:53:17.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.721+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fc71c0025c0 con 0x7fc7280629e0 2021-02-06T22:53:17.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fc71c002740 con 0x7fc7280629e0 2021-02-06T22:53:17.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fc71c0394e0 con 0x7fc7280629e0 2021-02-06T22:53:17.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 10 client.4401.objecter ms_dispatch 0x7fc728001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:17.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 3 client.4401.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:17.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 3 client.4401.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:17.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc7197fa700 20 client.4401.objecter dump_active .. 0 homeless 2021-02-06T22:53:17.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.722+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700004d60 con 0x7fc7280629e0 2021-02-06T22:53:17.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.725+0000 7fc7197fa700 10 client.4401.objecter ms_handle_connect 0x7fc7080307d0 2021-02-06T22:53:17.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.726+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fc71c012370 con 0x7fc7280629e0 2021-02-06T22:53:17.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.974+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc7000059b0 con 0x7fc7280629e0 2021-02-06T22:53:17.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.974+0000 7fc7197fa700 1 -- 172.21.15.51:0/2009494866 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fc71c011f60 con 0x7fc7280629e0 2021-02-06T22:53:17.974 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:17.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 10 librados: watch_flush enter 2021-02-06T22:53:17.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 10 librados: watch_flush exit 2021-02-06T22:53:17.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 20 client.4401.objecter shutdown clearing up homeless session... 2021-02-06T22:53:17.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 10 client.4401.objecter successfully canceled tick 2021-02-06T22:53:17.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.106:6812/33219 conn(0x7fc7080307d0 legacy=0x7fc708032c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 >> v1:172.21.15.51:6789/0 conn(0x7fc7280629e0 legacy=0x7fc72812e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:17.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 shutdown_connections 2021-02-06T22:53:17.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 >> 172.21.15.51:0/2009494866 conn(0x7fc728096860 msgr2=0x7fc728129f50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:17.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 shutdown_connections 2021-02-06T22:53:17.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 -- 172.21.15.51:0/2009494866 wait complete. 2021-02-06T22:53:17.978 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:17.976+0000 7fc72f2df700 1 librados: shutdown 2021-02-06T22:53:17.986 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:20.987 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:21.122 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.123+0000 7f0eca950700 1 Processor -- start 2021-02-06T22:53:21.123 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.123+0000 7f0eca950700 1 -- start start 2021-02-06T22:53:21.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0eca950700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4095440 con 0x7f0ec408fa70 2021-02-06T22:53:21.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0eca950700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40907b0 con 0x7f0ec412ce00 2021-02-06T22:53:21.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0eca950700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4091010 con 0x7f0ec4092bf0 2021-02-06T22:53:21.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0ec3fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0ec408fa70 0x7f0ec40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59802/0 (socket says 172.21.15.51:59802) 2021-02-06T22:53:21.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0ec37fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 0x7f0ec40930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60148/0 (socket says 172.21.15.51:60148) 2021-02-06T22:53:21.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.124+0000 7f0ec3fff700 1 -- 172.21.15.51:0/1687388905 learned_addr learned my addr 172.21.15.51:0/1687388905 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:21.127 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec3fff700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.51:6789/0 conn(0x7f0ec408fa70 legacy=0x7f0ec40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.127 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec37fe700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 legacy=0x7f0ec40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872546135 0 0) 0x7f0ec4095440 con 0x7f0ec408fa70 2021-02-06T22:53:21.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea4003230 con 0x7f0ec408fa70 2021-02-06T22:53:21.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109232476 0 0) 0x7f0ec4091010 con 0x7f0ec4092bf0 2021-02-06T22:53:21.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4095440 con 0x7f0ec4092bf0 2021-02-06T22:53:21.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec8eed700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.106:6789/0 conn(0x7f0ec412ce00 legacy=0x7f0ec412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.126+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 660739953 0 0) 0x7f0ea4003230 con 0x7f0ec408fa70 2021-02-06T22:53:21.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 legacy=0x7f0ec40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.106:6789/0 conn(0x7f0ec412ce00 legacy=0x7f0ec412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40912b0 con 0x7f0ec408fa70 2021-02-06T22:53:21.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0eb4001930 con 0x7f0ec408fa70 2021-02-06T22:53:21.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec3fff700 1 --1- 172.21.15.51:0/1687388905 >> v1:172.21.15.51:6789/0 conn(0x7f0ec408fa70 0x7f0ec40921a0 :-1 s=OPENED pgs=141 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f0eb4004750 mon_map magic: 0 v1 2021-02-06T22:53:21.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0eb4001c40 con 0x7f0ec408fa70 2021-02-06T22:53:21.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0eca950700 1 -- 172.21.15.51:0/1687388905 >> v1:172.21.15.51:6789/0 conn(0x7f0ec408fa70 legacy=0x7f0ec40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0ec2ffd700 1 -- 172.21.15.51:0/1687388905 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0eb4004750 con 0x7f0ec408fa70 2021-02-06T22:53:21.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0eca950700 1 -- 172.21.15.51:0/1687388905 shutdown_connections 2021-02-06T22:53:21.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0eca950700 1 -- 172.21.15.51:0/1687388905 >> 172.21.15.51:0/1687388905 conn(0x7f0ec4096860 msgr2=0x7f0ec4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:21.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0eca950700 1 -- 172.21.15.51:0/1687388905 shutdown_connections 2021-02-06T22:53:21.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.127+0000 7f0eca950700 1 -- 172.21.15.51:0/1687388905 wait complete. 2021-02-06T22:53:21.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 librados: starting msgr at 2021-02-06T22:53:21.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 librados: starting objecter 2021-02-06T22:53:21.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 Processor -- start 2021-02-06T22:53:21.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 -- start start 2021-02-06T22:53:21.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 librados: setting wanted keys 2021-02-06T22:53:21.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.128+0000 7f0eca950700 1 librados: calling monclient init 2021-02-06T22:53:21.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.129+0000 7f0eca950700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4111fd0 con 0x7f0ec412ce00 2021-02-06T22:53:21.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.129+0000 7f0eca950700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4112270 con 0x7f0ec408fa70 2021-02-06T22:53:21.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.129+0000 7f0eca950700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec4112510 con 0x7f0ec4092bf0 2021-02-06T22:53:21.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.129+0000 7f0ec37fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 0x7f0ec413cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60152/0 (socket says 172.21.15.51:60152) 2021-02-06T22:53:21.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.129+0000 7f0ec37fe700 1 -- 172.21.15.51:0/625477776 learned_addr learned my addr 172.21.15.51:0/625477776 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:21.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ec37fe700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 legacy=0x7f0ec413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ec8eed700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.51:6789/0 conn(0x7f0ec412ce00 legacy=0x7f0ec41402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter ms_handle_connect 0x7f0ec4092bf0 2021-02-06T22:53:21.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:21.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter ms_handle_connect 0x7f0ec412ce00 2021-02-06T22:53:21.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:21.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ec3fff700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.106:6789/0 conn(0x7f0ec408fa70 legacy=0x7f0ec4110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:21.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter ms_handle_connect 0x7f0ec408fa70 2021-02-06T22:53:21.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:21.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87546861 0 0) 0x7f0ec4112510 con 0x7f0ec4092bf0 2021-02-06T22:53:21.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8004bd0 con 0x7f0ec4092bf0 2021-02-06T22:53:21.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963374111 0 0) 0x7f0ec4111fd0 con 0x7f0ec412ce00 2021-02-06T22:53:21.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4112510 con 0x7f0ec412ce00 2021-02-06T22:53:21.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089359894 0 0) 0x7f0ec4112270 con 0x7f0ec408fa70 2021-02-06T22:53:21.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec4111fd0 con 0x7f0ec408fa70 2021-02-06T22:53:21.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2988978350 0 0) 0x7f0ec4112510 con 0x7f0ec412ce00 2021-02-06T22:53:21.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ec4112270 con 0x7f0ec412ce00 2021-02-06T22:53:21.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.131+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ebc001e20 con 0x7f0ec412ce00 2021-02-06T22:53:21.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3694196749 0 0) 0x7f0ea8004bd0 con 0x7f0ec4092bf0 2021-02-06T22:53:21.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ec4112510 con 0x7f0ec4092bf0 2021-02-06T22:53:21.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0eac001990 con 0x7f0ec4092bf0 2021-02-06T22:53:21.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3743883036 0 0) 0x7f0ec4111fd0 con 0x7f0ec408fa70 2021-02-06T22:53:21.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ea8004bd0 con 0x7f0ec408fa70 2021-02-06T22:53:21.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0eb40012e0 con 0x7f0ec408fa70 2021-02-06T22:53:21.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1129607113 0 0) 0x7f0ec4112270 con 0x7f0ec412ce00 2021-02-06T22:53:21.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.51:6790/0 conn(0x7f0ec4092bf0 legacy=0x7f0ec413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.106:6789/0 conn(0x7f0ec408fa70 legacy=0x7f0ec4110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4111a20 con 0x7f0ec412ce00 2021-02-06T22:53:21.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec412b0e0 con 0x7f0ec412ce00 2021-02-06T22:53:21.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0eca950700 10 client.4407.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:21.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec4110930 con 0x7f0ec412ce00 2021-02-06T22:53:21.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0eca950700 1 librados: init done 2021-02-06T22:53:21.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ebc0025b0 con 0x7f0ec412ce00 2021-02-06T22:53:21.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.132+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ebc002940 con 0x7f0ec412ce00 2021-02-06T22:53:21.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0ebc002b20 con 0x7f0ec412ce00 2021-02-06T22:53:21.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0ebc039760 con 0x7f0ec412ce00 2021-02-06T22:53:21.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 10 client.4407.objecter ms_dispatch 0x7f0ec4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:21.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 3 client.4407.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:21.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 3 client.4407.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:21.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0ebbfff700 20 client.4407.objecter dump_active .. 0 homeless 2021-02-06T22:53:21.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.133+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec406a270 con 0x7f0ec412ce00 2021-02-06T22:53:21.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.135+0000 7f0ebbfff700 10 client.4407.objecter ms_handle_connect 0x7f0ea8030820 2021-02-06T22:53:21.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.137+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0ebc012650 con 0x7f0ec412ce00 2021-02-06T22:53:21.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.383+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0ec40581b0 con 0x7f0ec412ce00 2021-02-06T22:53:21.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.383+0000 7f0ebbfff700 1 -- 172.21.15.51:0/625477776 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0ebc012240 con 0x7f0ec412ce00 2021-02-06T22:53:21.383 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:21.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 10 librados: watch_flush enter 2021-02-06T22:53:21.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 10 librados: watch_flush exit 2021-02-06T22:53:21.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 20 client.4407.objecter shutdown clearing up homeless session... 2021-02-06T22:53:21.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 10 client.4407.objecter successfully canceled tick 2021-02-06T22:53:21.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.106:6812/33219 conn(0x7f0ea8030820 legacy=0x7f0ea8032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 >> v1:172.21.15.51:6789/0 conn(0x7f0ec412ce00 legacy=0x7f0ec41402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:21.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 shutdown_connections 2021-02-06T22:53:21.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 >> 172.21.15.51:0/625477776 conn(0x7f0ec4096860 msgr2=0x7f0ec4093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:21.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 shutdown_connections 2021-02-06T22:53:21.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 -- 172.21.15.51:0/625477776 wait complete. 2021-02-06T22:53:21.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:21.385+0000 7f0eca950700 1 librados: shutdown 2021-02-06T22:53:21.396 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:24.397 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:24.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9393ad5700 1 Processor -- start 2021-02-06T22:53:24.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9393ad5700 1 -- start start 2021-02-06T22:53:24.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9393ad5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c093ce0 con 0x7f938c066d70 2021-02-06T22:53:24.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9393ad5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c12ab50 con 0x7f938c066910 2021-02-06T22:53:24.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9393ad5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c095f80 con 0x7f938c12afd0 2021-02-06T22:53:24.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9392072700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 0x7f938c132f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59816/0 (socket says 172.21.15.51:59816) 2021-02-06T22:53:24.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9391871700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f938c12afd0 0x7f938c12a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60158/0 (socket says 172.21.15.51:60158) 2021-02-06T22:53:24.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.533+0000 7f9392072700 1 -- 172.21.15.51:0/1864027211 learned_addr learned my addr 172.21.15.51:0/1864027211 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:24.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f9391871700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.51:6790/0 conn(0x7f938c12afd0 legacy=0x7f938c12a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f9392072700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 legacy=0x7f938c132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880417394 0 0) 0x7f938c093ce0 con 0x7f938c066d70 2021-02-06T22:53:24.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9374003230 con 0x7f938c066d70 2021-02-06T22:53:24.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910286764 0 0) 0x7f938c095f80 con 0x7f938c12afd0 2021-02-06T22:53:24.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c093ce0 con 0x7f938c12afd0 2021-02-06T22:53:24.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f9391070700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.106:6789/0 conn(0x7f938c066910 legacy=0x7f938c12f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3748273773 0 0) 0x7f938c093ce0 con 0x7f938c12afd0 2021-02-06T22:53:24.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.106:6789/0 conn(0x7f938c066910 legacy=0x7f938c12f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 legacy=0x7f938c132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0631a0 con 0x7f938c12afd0 2021-02-06T22:53:24.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9388001930 con 0x7f938c12afd0 2021-02-06T22:53:24.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9388001c40 con 0x7f938c12afd0 2021-02-06T22:53:24.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.536+0000 7f939086f700 1 -- 172.21.15.51:0/1864027211 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9388004690 con 0x7f938c12afd0 2021-02-06T22:53:24.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.537+0000 7f9393ad5700 1 -- 172.21.15.51:0/1864027211 >> v1:172.21.15.51:6790/0 conn(0x7f938c12afd0 legacy=0x7f938c12a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.537+0000 7f9393ad5700 1 -- 172.21.15.51:0/1864027211 shutdown_connections 2021-02-06T22:53:24.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.537+0000 7f9393ad5700 1 -- 172.21.15.51:0/1864027211 >> 172.21.15.51:0/1864027211 conn(0x7f938c0997e0 msgr2=0x7f938c099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:24.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.537+0000 7f9393ad5700 1 -- 172.21.15.51:0/1864027211 shutdown_connections 2021-02-06T22:53:24.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.537+0000 7f9393ad5700 1 -- 172.21.15.51:0/1864027211 wait complete. 2021-02-06T22:53:24.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 librados: starting msgr at 2021-02-06T22:53:24.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 librados: starting objecter 2021-02-06T22:53:24.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 Processor -- start 2021-02-06T22:53:24.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 -- start start 2021-02-06T22:53:24.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 librados: setting wanted keys 2021-02-06T22:53:24.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 librados: calling monclient init 2021-02-06T22:53:24.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c114550 con 0x7f938c066d70 2021-02-06T22:53:24.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c1147f0 con 0x7f938c066910 2021-02-06T22:53:24.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9393ad5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c114a90 con 0x7f938c12afd0 2021-02-06T22:53:24.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9391070700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 0x7f938c13eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59824/0 (socket says 172.21.15.51:59824) 2021-02-06T22:53:24.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.538+0000 7f9391070700 1 -- 172.21.15.51:0/29816423 learned_addr learned my addr 172.21.15.51:0/29816423 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:24.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9392072700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.51:6790/0 conn(0x7f938c12afd0 legacy=0x7f938c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9391070700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 legacy=0x7f938c13eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9379ffb700 10 client.?.objecter ms_handle_connect 0x7f938c12afd0 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9379ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9379ffb700 10 client.?.objecter ms_handle_connect 0x7f938c066d70 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.540+0000 7f9379ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725275096 0 0) 0x7f938c114a90 con 0x7f938c12afd0 2021-02-06T22:53:24.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f936c004bd0 con 0x7f938c12afd0 2021-02-06T22:53:24.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483520172 0 0) 0x7f938c114550 con 0x7f938c066d70 2021-02-06T22:53:24.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c114a90 con 0x7f938c066d70 2021-02-06T22:53:24.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 10 client.?.objecter ms_handle_connect 0x7f938c066910 2021-02-06T22:53:24.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:24.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9391871700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.106:6789/0 conn(0x7f938c066910 legacy=0x7f938c127050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:24.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2607745706 0 0) 0x7f936c004bd0 con 0x7f938c12afd0 2021-02-06T22:53:24.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f938c114550 con 0x7f938c12afd0 2021-02-06T22:53:24.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9384001fe0 con 0x7f938c12afd0 2021-02-06T22:53:24.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 104453163 0 0) 0x7f938c114a90 con 0x7f938c066d70 2021-02-06T22:53:24.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f936c004bd0 con 0x7f938c066d70 2021-02-06T22:53:24.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f937c001c70 con 0x7f938c066d70 2021-02-06T22:53:24.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150774836 0 0) 0x7f938c1147f0 con 0x7f938c066910 2021-02-06T22:53:24.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c114a90 con 0x7f938c066910 2021-02-06T22:53:24.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3643964205 0 0) 0x7f938c114550 con 0x7f938c12afd0 2021-02-06T22:53:24.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.106:6789/0 conn(0x7f938c066910 legacy=0x7f938c127050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.51:6789/0 conn(0x7f938c066d70 legacy=0x7f938c13eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c13a670 con 0x7f938c12afd0 2021-02-06T22:53:24.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c112920 con 0x7f938c12afd0 2021-02-06T22:53:24.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9384004c90 con 0x7f938c12afd0 2021-02-06T22:53:24.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9384004fa0 con 0x7f938c12afd0 2021-02-06T22:53:24.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9393ad5700 10 client.4403.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:24.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c12ef00 con 0x7f938c12afd0 2021-02-06T22:53:24.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.541+0000 7f9393ad5700 1 librados: init done 2021-02-06T22:53:24.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f9384005180 con 0x7f938c12afd0 2021-02-06T22:53:24.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f93840397e0 con 0x7f938c12afd0 2021-02-06T22:53:24.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 10 client.4403.objecter ms_dispatch 0x7f938c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:24.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 3 client.4403.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:24.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 3 client.4403.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:24.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9379ffb700 20 client.4403.objecter dump_active .. 0 homeless 2021-02-06T22:53:24.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.542+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938c098a60 con 0x7f938c12afd0 2021-02-06T22:53:24.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.545+0000 7f9379ffb700 10 client.4403.objecter ms_handle_connect 0x7f936c030730 2021-02-06T22:53:24.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.547+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f9384006680 con 0x7f938c12afd0 2021-02-06T22:53:24.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.795+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f938c0581b0 con 0x7f938c12afd0 2021-02-06T22:53:24.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.795+0000 7f9379ffb700 1 -- 172.21.15.51:0/29816423 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f93840122c0 con 0x7f938c12afd0 2021-02-06T22:53:24.795 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:24.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.796+0000 7f9393ad5700 10 librados: watch_flush enter 2021-02-06T22:53:24.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.796+0000 7f9393ad5700 10 librados: watch_flush exit 2021-02-06T22:53:24.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.796+0000 7f9393ad5700 20 client.4403.objecter shutdown clearing up homeless session... 2021-02-06T22:53:24.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.796+0000 7f9393ad5700 10 client.4403.objecter successfully canceled tick 2021-02-06T22:53:24.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.106:6812/33219 conn(0x7f936c030730 legacy=0x7f936c032bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 >> v1:172.21.15.51:6790/0 conn(0x7f938c12afd0 legacy=0x7f938c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:24.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 shutdown_connections 2021-02-06T22:53:24.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 >> 172.21.15.51:0/29816423 conn(0x7f938c0997e0 msgr2=0x7f938c0658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:24.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 shutdown_connections 2021-02-06T22:53:24.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 -- 172.21.15.51:0/29816423 wait complete. 2021-02-06T22:53:24.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:24.797+0000 7f9393ad5700 1 librados: shutdown 2021-02-06T22:53:24.807 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:27.808 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:27.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a56198700 1 Processor -- start 2021-02-06T22:53:27.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a56198700 1 -- start start 2021-02-06T22:53:27.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a56198700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50095440 con 0x7f3a5008fa70 2021-02-06T22:53:27.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a56198700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a500907b0 con 0x7f3a50092bf0 2021-02-06T22:53:27.944 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a56198700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50091010 con 0x7f3a5012ce00 2021-02-06T22:53:27.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a4ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3a5012ce00 0x7f3a5012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60172/0 (socket says 172.21.15.51:60172) 2021-02-06T22:53:27.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.944+0000 7f3a4ffff700 1 -- 172.21.15.51:0/78172931 learned_addr learned my addr 172.21.15.51:0/78172931 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:27.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.946+0000 7f3a4f7fe700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.51:6789/0 conn(0x7f3a5008fa70 legacy=0x7f3a500921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4ffff700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.51:6790/0 conn(0x7f3a5012ce00 legacy=0x7f3a5012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920732651 0 0) 0x7f3a50095440 con 0x7f3a5008fa70 2021-02-06T22:53:27.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a3c003230 con 0x7f3a5008fa70 2021-02-06T22:53:27.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683360496 0 0) 0x7f3a50091010 con 0x7f3a5012ce00 2021-02-06T22:53:27.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a50095440 con 0x7f3a5012ce00 2021-02-06T22:53:27.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4effd700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.106:6789/0 conn(0x7f3a50092bf0 legacy=0x7f3a500930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3691740459 0 0) 0x7f3a3c003230 con 0x7f3a5008fa70 2021-02-06T22:53:27.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.51:6790/0 conn(0x7f3a5012ce00 legacy=0x7f3a5012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:27.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.106:6789/0 conn(0x7f3a50092bf0 legacy=0x7f3a500930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:27.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500912b0 con 0x7f3a5008fa70 2021-02-06T22:53:27.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3a40001980 con 0x7f3a5008fa70 2021-02-06T22:53:27.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a40001c90 con 0x7f3a5008fa70 2021-02-06T22:53:27.950 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.947+0000 7f3a4e7fc700 1 -- 172.21.15.51:0/78172931 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3a40002060 con 0x7f3a5008fa70 2021-02-06T22:53:27.950 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 -- 172.21.15.51:0/78172931 >> v1:172.21.15.51:6789/0 conn(0x7f3a5008fa70 legacy=0x7f3a500921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:27.950 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 -- 172.21.15.51:0/78172931 shutdown_connections 2021-02-06T22:53:27.950 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 -- 172.21.15.51:0/78172931 >> 172.21.15.51:0/78172931 conn(0x7f3a50096860 msgr2=0x7f3a50099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:27.950 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 -- 172.21.15.51:0/78172931 shutdown_connections 2021-02-06T22:53:27.951 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 -- 172.21.15.51:0/78172931 wait complete. 2021-02-06T22:53:27.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 librados: starting msgr at 2021-02-06T22:53:27.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.948+0000 7f3a56198700 1 librados: starting objecter 2021-02-06T22:53:27.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 Processor -- start 2021-02-06T22:53:27.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 -- start start 2021-02-06T22:53:27.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 librados: setting wanted keys 2021-02-06T22:53:27.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 librados: calling monclient init 2021-02-06T22:53:27.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50124050 con 0x7f3a50092bf0 2021-02-06T22:53:27.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a50131b20 con 0x7f3a5012ce00 2021-02-06T22:53:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a56198700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a501242c0 con 0x7f3a5008fa70 2021-02-06T22:53:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a4f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3a5008fa70 0x7f3a50136f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60178/0 (socket says 172.21.15.51:60178) 2021-02-06T22:53:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a4f7fe700 1 -- 172.21.15.51:0/4160016191 learned_addr learned my addr 172.21.15.51:0/4160016191 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.949+0000 7f3a4effd700 1 --1- 172.21.15.51:0/4160016191 >> v1:172.21.15.51:6789/0 conn(0x7f3a50092bf0 0x7f3a5013bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59838/0 (socket says 172.21.15.51:59838) 2021-02-06T22:53:27.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a4f7fe700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.51:6790/0 conn(0x7f3a5008fa70 legacy=0x7f3a50136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a377fe700 10 client.?.objecter ms_handle_connect 0x7f3a5008fa70 2021-02-06T22:53:27.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:27.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a377fe700 10 client.?.objecter ms_handle_connect 0x7f3a50092bf0 2021-02-06T22:53:27.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:27.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.951+0000 7f3a4effd700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.51:6789/0 conn(0x7f3a50092bf0 legacy=0x7f3a5013bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597558118 0 0) 0x7f3a501242c0 con 0x7f3a5008fa70 2021-02-06T22:53:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a30004bd0 con 0x7f3a5008fa70 2021-02-06T22:53:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462713597 0 0) 0x7f3a50124050 con 0x7f3a50092bf0 2021-02-06T22:53:27.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a501242c0 con 0x7f3a50092bf0 2021-02-06T22:53:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a4ffff700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.106:6789/0 conn(0x7f3a5012ce00 legacy=0x7f3a5013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 10 client.?.objecter ms_handle_connect 0x7f3a5012ce00 2021-02-06T22:53:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:27.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 604621687 0 0) 0x7f3a30004bd0 con 0x7f3a5008fa70 2021-02-06T22:53:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a50124050 con 0x7f3a5008fa70 2021-02-06T22:53:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3a40001940 con 0x7f3a5008fa70 2021-02-06T22:53:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4240856068 0 0) 0x7f3a501242c0 con 0x7f3a50092bf0 2021-02-06T22:53:27.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3a30004bd0 con 0x7f3a50092bf0 2021-02-06T22:53:27.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567463620 0 0) 0x7f3a50131b20 con 0x7f3a5012ce00 2021-02-06T22:53:27.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a501242c0 con 0x7f3a5012ce00 2021-02-06T22:53:27.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3a44001b60 con 0x7f3a50092bf0 2021-02-06T22:53:27.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1672639126 0 0) 0x7f3a50124050 con 0x7f3a5008fa70 2021-02-06T22:53:27.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.106:6789/0 conn(0x7f3a5012ce00 legacy=0x7f3a5013f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:27.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.51:6789/0 conn(0x7f3a50092bf0 legacy=0x7f3a5013bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:27.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a50124560 con 0x7f3a5008fa70 2021-02-06T22:53:27.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a50133070 con 0x7f3a5008fa70 2021-02-06T22:53:27.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3a40002780 con 0x7f3a5008fa70 2021-02-06T22:53:27.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3a40002a90 con 0x7f3a5008fa70 2021-02-06T22:53:27.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a56198700 10 client.4409.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:27.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a50137620 con 0x7f3a5008fa70 2021-02-06T22:53:27.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.952+0000 7f3a56198700 1 librados: init done 2021-02-06T22:53:27.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3a4000db30 con 0x7f3a5008fa70 2021-02-06T22:53:27.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3a400396a0 con 0x7f3a5008fa70 2021-02-06T22:53:27.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 10 client.4409.objecter ms_dispatch 0x7f3a50001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:27.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 3 client.4409.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:27.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 3 client.4409.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:27.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a377fe700 20 client.4409.objecter dump_active .. 0 homeless 2021-02-06T22:53:27.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.953+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a501378d0 con 0x7f3a5008fa70 2021-02-06T22:53:27.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.956+0000 7f3a377fe700 10 client.4409.objecter ms_handle_connect 0x7f3a30030780 2021-02-06T22:53:27.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:27.957+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f3a40012650 con 0x7f3a5008fa70 2021-02-06T22:53:28.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.207+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3a500581b0 con 0x7f3a5008fa70 2021-02-06T22:53:28.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.207+0000 7f3a377fe700 1 -- 172.21.15.51:0/4160016191 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f3a40012240 con 0x7f3a5008fa70 2021-02-06T22:53:28.207 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:28.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 10 librados: watch_flush enter 2021-02-06T22:53:28.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 10 librados: watch_flush exit 2021-02-06T22:53:28.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 20 client.4409.objecter shutdown clearing up homeless session... 2021-02-06T22:53:28.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 10 client.4409.objecter successfully canceled tick 2021-02-06T22:53:28.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.106:6812/33219 conn(0x7f3a30030780 legacy=0x7f3a30032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:28.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 >> v1:172.21.15.51:6790/0 conn(0x7f3a5008fa70 legacy=0x7f3a50136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:28.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 shutdown_connections 2021-02-06T22:53:28.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 >> 172.21.15.51:0/4160016191 conn(0x7f3a50096860 msgr2=0x7f3a50093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:28.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 shutdown_connections 2021-02-06T22:53:28.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 -- 172.21.15.51:0/4160016191 wait complete. 2021-02-06T22:53:28.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:28.209+0000 7f3a56198700 1 librados: shutdown 2021-02-06T22:53:28.219 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:31.221 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:31.355 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.356+0000 7fe2a0fe6700 1 Processor -- start 2021-02-06T22:53:31.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.356+0000 7fe2a0fe6700 1 -- start start 2021-02-06T22:53:31.356 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.357+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c095440 con 0x7fe29c08fa70 2021-02-06T22:53:31.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.357+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0907b0 con 0x7fe29c12ce00 2021-02-06T22:53:31.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.357+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c091010 con 0x7fe29c092bf0 2021-02-06T22:53:31.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.357+0000 7fe29a59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe29c08fa70 0x7fe29c0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59844/0 (socket says 172.21.15.51:59844) 2021-02-06T22:53:31.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.357+0000 7fe29a59c700 1 -- 172.21.15.51:0/3087408795 learned_addr learned my addr 172.21.15.51:0/3087408795 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:31.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29a59c700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.51:6789/0 conn(0x7fe29c08fa70 legacy=0x7fe29c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe299d9b700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.51:6790/0 conn(0x7fe29c092bf0 legacy=0x7fe29c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183645453 0 0) 0x7fe29c095440 con 0x7fe29c08fa70 2021-02-06T22:53:31.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280003230 con 0x7fe29c08fa70 2021-02-06T22:53:31.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29ad9d700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.106:6789/0 conn(0x7fe29c12ce00 legacy=0x7fe29c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812603090 0 0) 0x7fe29c091010 con 0x7fe29c092bf0 2021-02-06T22:53:31.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.359+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c095440 con 0x7fe29c092bf0 2021-02-06T22:53:31.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903639503 0 0) 0x7fe29c0907b0 con 0x7fe29c12ce00 2021-02-06T22:53:31.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c091010 con 0x7fe29c12ce00 2021-02-06T22:53:31.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2350603542 0 0) 0x7fe280003230 con 0x7fe29c08fa70 2021-02-06T22:53:31.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.51:6790/0 conn(0x7fe29c092bf0 legacy=0x7fe29c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.106:6789/0 conn(0x7fe29c12ce00 legacy=0x7fe29c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0912b0 con 0x7fe29c08fa70 2021-02-06T22:53:31.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe28c001930 con 0x7fe29c08fa70 2021-02-06T22:53:31.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe28c001c40 con 0x7fe29c08fa70 2021-02-06T22:53:31.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe29959a700 1 -- 172.21.15.51:0/3087408795 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe28c004750 con 0x7fe29c08fa70 2021-02-06T22:53:31.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/3087408795 >> v1:172.21.15.51:6789/0 conn(0x7fe29c08fa70 legacy=0x7fe29c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.360+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/3087408795 shutdown_connections 2021-02-06T22:53:31.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/3087408795 >> 172.21.15.51:0/3087408795 conn(0x7fe29c096860 msgr2=0x7fe29c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:31.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/3087408795 shutdown_connections 2021-02-06T22:53:31.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/3087408795 wait complete. 2021-02-06T22:53:31.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 librados: starting msgr at 2021-02-06T22:53:31.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 librados: starting objecter 2021-02-06T22:53:31.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 Processor -- start 2021-02-06T22:53:31.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 -- start start 2021-02-06T22:53:31.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 librados: setting wanted keys 2021-02-06T22:53:31.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.361+0000 7fe2a0fe6700 1 librados: calling monclient init 2021-02-06T22:53:31.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c090bf0 con 0x7fe29c12ce00 2021-02-06T22:53:31.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c130810 con 0x7fe29c092bf0 2021-02-06T22:53:31.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe2a0fe6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c130ab0 con 0x7fe29c08fa70 2021-02-06T22:53:31.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe29ad9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe29c12ce00 0x7fe29c1400e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59854/0 (socket says 172.21.15.51:59854) 2021-02-06T22:53:31.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe29a59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe29c08fa70 0x7fe29c131cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60192/0 (socket says 172.21.15.51:60192) 2021-02-06T22:53:31.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.362+0000 7fe29ad9d700 1 -- 172.21.15.51:0/486384493 learned_addr learned my addr 172.21.15.51:0/486384493 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:31.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe29ad9d700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.51:6789/0 conn(0x7fe29c12ce00 legacy=0x7fe29c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter ms_handle_connect 0x7fe29c12ce00 2021-02-06T22:53:31.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:31.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter ms_handle_connect 0x7fe29c08fa70 2021-02-06T22:53:31.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:31.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe29a59c700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.51:6790/0 conn(0x7fe29c08fa70 legacy=0x7fe29c131cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter ms_handle_connect 0x7fe29c092bf0 2021-02-06T22:53:31.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:31.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe299d9b700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.106:6789/0 conn(0x7fe29c092bf0 legacy=0x7fe29c13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:31.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537867156 0 0) 0x7fe29c090bf0 con 0x7fe29c12ce00 2021-02-06T22:53:31.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe278004bd0 con 0x7fe29c12ce00 2021-02-06T22:53:31.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297953988 0 0) 0x7fe29c130ab0 con 0x7fe29c08fa70 2021-02-06T22:53:31.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.364+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe29c090bf0 con 0x7fe29c08fa70 2021-02-06T22:53:31.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1090405053 0 0) 0x7fe278004bd0 con 0x7fe29c12ce00 2021-02-06T22:53:31.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe29c130ab0 con 0x7fe29c12ce00 2021-02-06T22:53:31.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe294001fa0 con 0x7fe29c12ce00 2021-02-06T22:53:31.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789124924 0 0) 0x7fe29c130810 con 0x7fe29c092bf0 2021-02-06T22:53:31.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe278004bd0 con 0x7fe29c092bf0 2021-02-06T22:53:31.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2648691579 0 0) 0x7fe29c090bf0 con 0x7fe29c08fa70 2021-02-06T22:53:31.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe29c130810 con 0x7fe29c08fa70 2021-02-06T22:53:31.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe28c0018f0 con 0x7fe29c08fa70 2021-02-06T22:53:31.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1470108550 0 0) 0x7fe29c130ab0 con 0x7fe29c12ce00 2021-02-06T22:53:31.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.51:6790/0 conn(0x7fe29c08fa70 legacy=0x7fe29c131cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.106:6789/0 conn(0x7fe29c092bf0 legacy=0x7fe29c13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c12e940 con 0x7fe29c12ce00 2021-02-06T22:53:31.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c1323e0 con 0x7fe29c12ce00 2021-02-06T22:53:31.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe2a0fe6700 10 client.4425.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:31.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c132690 con 0x7fe29c12ce00 2021-02-06T22:53:31.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.365+0000 7fe2a0fe6700 1 librados: init done 2021-02-06T22:53:31.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c130670 con 0x7fe29c12ce00 2021-02-06T22:53:31.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe2940025b0 con 0x7fe29c12ce00 2021-02-06T22:53:31.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2940028c0 con 0x7fe29c12ce00 2021-02-06T22:53:31.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fe294002a20 con 0x7fe29c12ce00 2021-02-06T22:53:31.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fe294039810 con 0x7fe29c12ce00 2021-02-06T22:53:31.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 10 client.4425.objecter ms_dispatch 0x7fe29c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:31.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 3 client.4425.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:31.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 3 client.4425.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:31.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.366+0000 7fe28a7fc700 20 client.4425.objecter dump_active .. 0 homeless 2021-02-06T22:53:31.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.369+0000 7fe28a7fc700 10 client.4425.objecter ms_handle_connect 0x7fe2780307f0 2021-02-06T22:53:31.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.370+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fe29c130670 con 0x7fe29c12ce00 2021-02-06T22:53:31.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.620+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe29c130670 con 0x7fe29c12ce00 2021-02-06T22:53:31.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.620+0000 7fe28a7fc700 1 -- 172.21.15.51:0/486384493 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fe29c130670 con 0x7fe29c12ce00 2021-02-06T22:53:31.620 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:31.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 10 librados: watch_flush enter 2021-02-06T22:53:31.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 10 librados: watch_flush exit 2021-02-06T22:53:31.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 20 client.4425.objecter shutdown clearing up homeless session... 2021-02-06T22:53:31.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 10 client.4425.objecter successfully canceled tick 2021-02-06T22:53:31.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.106:6812/33219 conn(0x7fe2780307f0 legacy=0x7fe278032cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 >> v1:172.21.15.51:6789/0 conn(0x7fe29c12ce00 legacy=0x7fe29c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:31.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 shutdown_connections 2021-02-06T22:53:31.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 >> 172.21.15.51:0/486384493 conn(0x7fe29c096860 msgr2=0x7fe29c098040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:31.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 shutdown_connections 2021-02-06T22:53:31.624 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 -- 172.21.15.51:0/486384493 wait complete. 2021-02-06T22:53:31.624 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:31.622+0000 7fe2a0fe6700 1 librados: shutdown 2021-02-06T22:53:31.632 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:34.633 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:34.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.769+0000 7f07ebd06700 1 Processor -- start 2021-02-06T22:53:34.769 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07ebd06700 1 -- start start 2021-02-06T22:53:34.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07ebd06700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40915d0 con 0x7f07e40999a0 2021-02-06T22:53:34.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07ebd06700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4091ac0 con 0x7f07e40629e0 2021-02-06T22:53:34.770 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07ebd06700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4091d60 con 0x7f07e40928d0 2021-02-06T22:53:34.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07e9aa2700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f07e40999a0 0x7f07e40907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59858/0 (socket says 172.21.15.51:59858) 2021-02-06T22:53:34.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07e9aa2700 1 -- 172.21.15.51:0/784745601 learned_addr learned my addr 172.21.15.51:0/784745601 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:34.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.770+0000 7f07ea2a3700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 0x7f07e412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60204/0 (socket says 172.21.15.51:60204) 2021-02-06T22:53:34.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.772+0000 7f07ea2a3700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 legacy=0x7f07e412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.772+0000 7f07e9aa2700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.51:6789/0 conn(0x7f07e40999a0 legacy=0x7f07e40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14789610 0 0) 0x7f07e4091d60 con 0x7f07e40928d0 2021-02-06T22:53:34.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc003230 con 0x7f07e40928d0 2021-02-06T22:53:34.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040203060 0 0) 0x7f07e40915d0 con 0x7f07e40999a0 2021-02-06T22:53:34.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4091d60 con 0x7f07e40999a0 2021-02-06T22:53:34.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e92a1700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.106:6789/0 conn(0x7f07e40629e0 legacy=0x7f07e4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441868954 0 0) 0x7f07e4091ac0 con 0x7f07e40629e0 2021-02-06T22:53:34.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e40915d0 con 0x7f07e40629e0 2021-02-06T22:53:34.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3399862111 0 0) 0x7f07cc003230 con 0x7f07e40928d0 2021-02-06T22:53:34.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.106:6789/0 conn(0x7f07e40629e0 legacy=0x7f07e4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:34.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.51:6789/0 conn(0x7f07e40999a0 legacy=0x7f07e40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:34.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4092000 con 0x7f07e40928d0 2021-02-06T22:53:34.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f07dc001cb0 con 0x7f07e40928d0 2021-02-06T22:53:34.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f07dc001fc0 con 0x7f07e40928d0 2021-02-06T22:53:34.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.773+0000 7f07e8aa0700 1 -- 172.21.15.51:0/784745601 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f07dc004a10 con 0x7f07e40928d0 2021-02-06T22:53:34.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 -- 172.21.15.51:0/784745601 >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 legacy=0x7f07e412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:34.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 -- 172.21.15.51:0/784745601 shutdown_connections 2021-02-06T22:53:34.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 -- 172.21.15.51:0/784745601 >> 172.21.15.51:0/784745601 conn(0x7f07e4096860 msgr2=0x7f07e4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:34.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 -- 172.21.15.51:0/784745601 shutdown_connections 2021-02-06T22:53:34.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 -- 172.21.15.51:0/784745601 wait complete. 2021-02-06T22:53:34.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 librados: starting msgr at 2021-02-06T22:53:34.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.774+0000 7f07ebd06700 1 librados: starting objecter 2021-02-06T22:53:34.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 Processor -- start 2021-02-06T22:53:34.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 -- start start 2021-02-06T22:53:34.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 librados: setting wanted keys 2021-02-06T22:53:34.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 librados: calling monclient init 2021-02-06T22:53:34.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4095160 con 0x7f07e40999a0 2021-02-06T22:53:34.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4067480 con 0x7f07e40629e0 2021-02-06T22:53:34.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07ebd06700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e4130c60 con 0x7f07e40928d0 2021-02-06T22:53:34.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07e92a1700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 0x7f07e41397d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60208/0 (socket says 172.21.15.51:60208) 2021-02-06T22:53:34.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.775+0000 7f07e92a1700 1 -- 172.21.15.51:0/753036956 learned_addr learned my addr 172.21.15.51:0/753036956 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:34.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07ea2a3700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.51:6789/0 conn(0x7f07e40999a0 legacy=0x7f07e4141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 10 client.?.objecter ms_handle_connect 0x7f07e40999a0 2021-02-06T22:53:34.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07e92a1700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 legacy=0x7f07e41397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:34.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 10 client.?.objecter ms_handle_connect 0x7f07e40928d0 2021-02-06T22:53:34.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:34.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678066318 0 0) 0x7f07e4095160 con 0x7f07e40999a0 2021-02-06T22:53:34.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c4004bd0 con 0x7f07e40999a0 2021-02-06T22:53:34.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.777+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962278680 0 0) 0x7f07e4130c60 con 0x7f07e40928d0 2021-02-06T22:53:34.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4095160 con 0x7f07e40928d0 2021-02-06T22:53:34.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 10 client.?.objecter ms_handle_connect 0x7f07e40629e0 2021-02-06T22:53:34.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:34.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07e9aa2700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.106:6789/0 conn(0x7f07e40629e0 legacy=0x7f07e4130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:34.786 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 23894899 0 0) 0x7f07c4004bd0 con 0x7f07e40999a0 2021-02-06T22:53:34.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07e4130c60 con 0x7f07e40999a0 2021-02-06T22:53:34.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f07dc001c70 con 0x7f07e40999a0 2021-02-06T22:53:34.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215306701 0 0) 0x7f07e4067480 con 0x7f07e40629e0 2021-02-06T22:53:34.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c4004bd0 con 0x7f07e40629e0 2021-02-06T22:53:34.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 757551538 0 0) 0x7f07e4095160 con 0x7f07e40928d0 2021-02-06T22:53:34.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07e4067480 con 0x7f07e40928d0 2021-02-06T22:53:34.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f07d4001c40 con 0x7f07e40928d0 2021-02-06T22:53:34.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 234381393 0 0) 0x7f07e4130c60 con 0x7f07e40999a0 2021-02-06T22:53:34.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.51:6790/0 conn(0x7f07e40928d0 legacy=0x7f07e41397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:34.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.106:6789/0 conn(0x7f07e40629e0 legacy=0x7f07e4130550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:34.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e411acc0 con 0x7f07e40999a0 2021-02-06T22:53:34.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e411af60 con 0x7f07e40999a0 2021-02-06T22:53:34.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f07dc005120 con 0x7f07e40999a0 2021-02-06T22:53:34.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f07dc005430 con 0x7f07e40999a0 2021-02-06T22:53:34.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07ebd06700 10 client.4431.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:34.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e4139fa0 con 0x7f07e40999a0 2021-02-06T22:53:34.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.778+0000 7f07ebd06700 1 librados: init done 2021-02-06T22:53:34.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f07dc00dbf0 con 0x7f07e40999a0 2021-02-06T22:53:34.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f07dc0398d0 con 0x7f07e40999a0 2021-02-06T22:53:34.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 10 client.4431.objecter ms_dispatch 0x7f07e4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:34.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 3 client.4431.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:34.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 3 client.4431.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:34.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07d1ffb700 20 client.4431.objecter dump_active .. 0 homeless 2021-02-06T22:53:34.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.779+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e40581b0 con 0x7f07e40999a0 2021-02-06T22:53:34.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.782+0000 7f07d1ffb700 10 client.4431.objecter ms_handle_connect 0x7f07c40307b0 2021-02-06T22:53:34.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:34.783+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f07dc0127c0 con 0x7f07e40999a0 2021-02-06T22:53:35.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.032+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07e40923c0 con 0x7f07e40999a0 2021-02-06T22:53:35.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.032+0000 7f07d1ffb700 1 -- 172.21.15.51:0/753036956 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f07dc0123b0 con 0x7f07e40999a0 2021-02-06T22:53:35.032 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:35.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 10 librados: watch_flush enter 2021-02-06T22:53:35.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 10 librados: watch_flush exit 2021-02-06T22:53:35.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 20 client.4431.objecter shutdown clearing up homeless session... 2021-02-06T22:53:35.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 10 client.4431.objecter successfully canceled tick 2021-02-06T22:53:35.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.106:6812/33219 conn(0x7f07c40307b0 legacy=0x7f07c4032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:35.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 >> v1:172.21.15.51:6789/0 conn(0x7f07e40999a0 legacy=0x7f07e4141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:35.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 shutdown_connections 2021-02-06T22:53:35.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 >> 172.21.15.51:0/753036956 conn(0x7f07e4096860 msgr2=0x7f07e408ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:35.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 shutdown_connections 2021-02-06T22:53:35.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 -- 172.21.15.51:0/753036956 wait complete. 2021-02-06T22:53:35.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:35.034+0000 7f07ebd06700 1 librados: shutdown 2021-02-06T22:53:35.044 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:38.046 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:38.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.182+0000 7f038b39d700 1 Processor -- start 2021-02-06T22:53:38.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.182+0000 7f038b39d700 1 -- start start 2021-02-06T22:53:38.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f038b39d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03840953e0 con 0x7f0384091f60 2021-02-06T22:53:38.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f038b39d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384094900 con 0x7f038408f510 2021-02-06T22:53:38.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f038b39d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384090dd0 con 0x7f038412cd50 2021-02-06T22:53:38.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f038ab9c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f038412cd50 0x7f038412f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60222/0 (socket says 172.21.15.51:60222) 2021-02-06T22:53:38.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f0389b9a700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 0x7f03840941f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59876/0 (socket says 172.21.15.51:59876) 2021-02-06T22:53:38.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.183+0000 7f038ab9c700 1 -- 172.21.15.51:0/2888740859 learned_addr learned my addr 172.21.15.51:0/2888740859 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:38.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f038ab9c700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.51:6790/0 conn(0x7f038412cd50 legacy=0x7f038412f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389b9a700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 legacy=0x7f03840941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310918419 0 0) 0x7f03840953e0 con 0x7f0384091f60 2021-02-06T22:53:38.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f036c003230 con 0x7f0384091f60 2021-02-06T22:53:38.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f038a39b700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.106:6789/0 conn(0x7f038408f510 legacy=0x7f0384093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 80150293 0 0) 0x7f036c003230 con 0x7f0384091f60 2021-02-06T22:53:38.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.51:6790/0 conn(0x7f038412cd50 legacy=0x7f038412f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.106:6789/0 conn(0x7f038408f510 legacy=0x7f0384093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384091070 con 0x7f0384091f60 2021-02-06T22:53:38.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.185+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0380001930 con 0x7f0384091f60 2021-02-06T22:53:38.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0380001c40 con 0x7f0384091f60 2021-02-06T22:53:38.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f0389399700 1 -- 172.21.15.51:0/2888740859 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0380004690 con 0x7f0384091f60 2021-02-06T22:53:38.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f038b39d700 1 -- 172.21.15.51:0/2888740859 >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 legacy=0x7f03840941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f038b39d700 1 -- 172.21.15.51:0/2888740859 shutdown_connections 2021-02-06T22:53:38.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f038b39d700 1 -- 172.21.15.51:0/2888740859 >> 172.21.15.51:0/2888740859 conn(0x7f0384095be0 msgr2=0x7f0384095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:38.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f038b39d700 1 -- 172.21.15.51:0/2888740859 shutdown_connections 2021-02-06T22:53:38.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.186+0000 7f038b39d700 1 -- 172.21.15.51:0/2888740859 wait complete. 2021-02-06T22:53:38.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 librados: starting msgr at 2021-02-06T22:53:38.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 librados: starting objecter 2021-02-06T22:53:38.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 Processor -- start 2021-02-06T22:53:38.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 -- start start 2021-02-06T22:53:38.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 librados: setting wanted keys 2021-02-06T22:53:38.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.187+0000 7f038b39d700 1 librados: calling monclient init 2021-02-06T22:53:38.198 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f038b39d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384066840 con 0x7f0384091f60 2021-02-06T22:53:38.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f038b39d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384066b50 con 0x7f038412cd50 2021-02-06T22:53:38.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f038b39d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0384066df0 con 0x7f038408f510 2021-02-06T22:53:38.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f038a39b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f038408f510 0x7f0384123ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60224/0 (socket says 172.21.15.51:60224) 2021-02-06T22:53:38.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f038a39b700 1 -- 172.21.15.51:0/2509489737 learned_addr learned my addr 172.21.15.51:0/2509489737 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:38.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.188+0000 7f0389b9a700 1 --1- 172.21.15.51:0/2509489737 >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 0x7f0384124600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59884/0 (socket says 172.21.15.51:59884) 2021-02-06T22:53:38.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f0389b9a700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 legacy=0x7f0384124600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f038a39b700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.51:6790/0 conn(0x7f038408f510 legacy=0x7f0384123ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter ms_handle_connect 0x7f0384091f60 2021-02-06T22:53:38.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:38.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter ms_handle_connect 0x7f038408f510 2021-02-06T22:53:38.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:38.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348019602 0 0) 0x7f0384066840 con 0x7f0384091f60 2021-02-06T22:53:38.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364004bd0 con 0x7f0384091f60 2021-02-06T22:53:38.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f038ab9c700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.106:6789/0 conn(0x7f038412cd50 legacy=0x7f038413d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:38.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter ms_handle_connect 0x7f038412cd50 2021-02-06T22:53:38.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:38.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f038ab9c700 1 --1- 172.21.15.51:0/2509489737 >> v1:172.21.15.106:6789/0 conn(0x7f038412cd50 0x7f038413d490 :-1 s=OPENED pgs=142 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f0384066b50 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:53:38.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1771042103 0 0) 0x7f0364004bd0 con 0x7f0384091f60 2021-02-06T22:53:38.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0384066840 con 0x7f0384091f60 2021-02-06T22:53:38.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f03800018f0 con 0x7f0384091f60 2021-02-06T22:53:38.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1986554972 0 0) 0x7f0384066840 con 0x7f0384091f60 2021-02-06T22:53:38.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.51:6790/0 conn(0x7f038408f510 legacy=0x7f0384123ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.106:6789/0 conn(0x7f038412cd50 legacy=0x7f038413d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384067090 con 0x7f0384091f60 2021-02-06T22:53:38.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.190+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548420606 0 0) 0x7f0384066b50 con 0x7f038412cd50 2021-02-06T22:53:38.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03840651c0 con 0x7f0384091f60 2021-02-06T22:53:38.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f038b39d700 10 client.4437.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:38.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0380004da0 con 0x7f0384091f60 2021-02-06T22:53:38.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384064620 con 0x7f0384091f60 2021-02-06T22:53:38.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f038b39d700 1 librados: init done 2021-02-06T22:53:38.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f03800050b0 con 0x7f0384091f60 2021-02-06T22:53:38.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f038000d870 con 0x7f0384091f60 2021-02-06T22:53:38.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0380039610 con 0x7f0384091f60 2021-02-06T22:53:38.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 10 client.4437.objecter ms_dispatch 0x7f0384001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:38.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 3 client.4437.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:38.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f03767fc700 3 client.4437.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:38.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.191+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03840581b0 con 0x7f0384091f60 2021-02-06T22:53:38.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.192+0000 7f03767fc700 20 client.4437.objecter dump_active .. 0 homeless 2021-02-06T22:53:38.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.194+0000 7f03767fc700 10 client.4437.objecter ms_handle_connect 0x7f03640303f0 2021-02-06T22:53:38.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.196+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0380012500 con 0x7f0384091f60 2021-02-06T22:53:38.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.450+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f03840648d0 con 0x7f0384091f60 2021-02-06T22:53:38.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.450+0000 7f03767fc700 1 -- 172.21.15.51:0/2509489737 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0380012500 con 0x7f0384091f60 2021-02-06T22:53:38.450 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:38.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 10 librados: watch_flush enter 2021-02-06T22:53:38.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 10 librados: watch_flush exit 2021-02-06T22:53:38.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 20 client.4437.objecter shutdown clearing up homeless session... 2021-02-06T22:53:38.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 10 client.4437.objecter successfully canceled tick 2021-02-06T22:53:38.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.106:6812/33219 conn(0x7f03640303f0 legacy=0x7f03640328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 >> v1:172.21.15.51:6789/0 conn(0x7f0384091f60 legacy=0x7f0384124600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:38.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 shutdown_connections 2021-02-06T22:53:38.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 >> 172.21.15.51:0/2509489737 conn(0x7f0384095be0 msgr2=0x7f0384127b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:38.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 shutdown_connections 2021-02-06T22:53:38.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 -- 172.21.15.51:0/2509489737 wait complete. 2021-02-06T22:53:38.454 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:38.452+0000 7f038b39d700 1 librados: shutdown 2021-02-06T22:53:38.463 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:41.464 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:41.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ef4cb700 1 Processor -- start 2021-02-06T22:53:41.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ef4cb700 1 -- start start 2021-02-06T22:53:41.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ef4cb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80915d0 con 0x7f39e80999a0 2021-02-06T22:53:41.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ef4cb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8091ac0 con 0x7f39e80928d0 2021-02-06T22:53:41.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ef4cb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8091d60 con 0x7f39e80629e0 2021-02-06T22:53:41.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ed267700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 0x7f39e80907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59892/0 (socket says 172.21.15.51:59892) 2021-02-06T22:53:41.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39ed267700 1 -- 172.21.15.51:0/3435780348 learned_addr learned my addr 172.21.15.51:0/3435780348 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:41.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.600+0000 7f39eca66700 1 --1- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6790/0 conn(0x7f39e80629e0 0x7f39e8090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60234/0 (socket says 172.21.15.51:60234) 2021-02-06T22:53:41.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39ed267700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 legacy=0x7f39e80907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39ed267700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 legacy=0x7f39e80907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-02-06T22:53:41.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39ed267700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 legacy=0x7f39e80907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:53:41.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39ed267700 1 --1- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 0x7f39e80907b0 :-1 s=OPENED pgs=157 cs=1 l=1).handle_message read tag failed 2021-02-06T22:53:41.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39ed267700 1 --1- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 0x7f39e80907b0 :-1 s=OPENED pgs=157 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:53:41.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39eca66700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6790/0 conn(0x7f39e80629e0 legacy=0x7f39e8090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140623769 0 0) 0x7f39e8091d60 con 0x7f39e80629e0 2021-02-06T22:53:41.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d0003230 con 0x7f39e80629e0 2021-02-06T22:53:41.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39eda68700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.106:6789/0 conn(0x7f39e80928d0 legacy=0x7f39e812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 386862167 0 0) 0x7f39d0003230 con 0x7f39e80629e0 2021-02-06T22:53:41.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.106:6789/0 conn(0x7f39e80928d0 legacy=0x7f39e812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6789/0 conn(0x7f39e80999a0 legacy=0x7f39e80907b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:53:41.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8092000 con 0x7f39e80629e0 2021-02-06T22:53:41.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39e4001860 con 0x7f39e80629e0 2021-02-06T22:53:41.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f39e4001b70 con 0x7f39e80629e0 2021-02-06T22:53:41.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.603+0000 7f39dbfff700 1 -- 172.21.15.51:0/3435780348 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39e40044f0 con 0x7f39e80629e0 2021-02-06T22:53:41.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.604+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3435780348 >> v1:172.21.15.51:6790/0 conn(0x7f39e80629e0 legacy=0x7f39e8090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.604+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3435780348 shutdown_connections 2021-02-06T22:53:41.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.604+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3435780348 >> 172.21.15.51:0/3435780348 conn(0x7f39e8096860 msgr2=0x7f39e8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:41.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.604+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3435780348 shutdown_connections 2021-02-06T22:53:41.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.604+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3435780348 wait complete. 2021-02-06T22:53:41.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 librados: starting msgr at 2021-02-06T22:53:41.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 librados: starting objecter 2021-02-06T22:53:41.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 Processor -- start 2021-02-06T22:53:41.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 -- start start 2021-02-06T22:53:41.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 librados: setting wanted keys 2021-02-06T22:53:41.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 librados: calling monclient init 2021-02-06T22:53:41.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8095160 con 0x7f39e80629e0 2021-02-06T22:53:41.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8116440 con 0x7f39e80928d0 2021-02-06T22:53:41.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ef4cb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8097aa0 con 0x7f39e80999a0 2021-02-06T22:53:41.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ed267700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f39e80629e0 0x7f39e8135a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59898/0 (socket says 172.21.15.51:59898) 2021-02-06T22:53:41.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.605+0000 7f39ed267700 1 -- 172.21.15.51:0/3382474482 learned_addr learned my addr 172.21.15.51:0/3382474482 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:41.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39eda68700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.51:6790/0 conn(0x7f39e80999a0 legacy=0x7f39e813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39ed267700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.51:6789/0 conn(0x7f39e80629e0 legacy=0x7f39e8135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter ms_handle_connect 0x7f39e80999a0 2021-02-06T22:53:41.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:41.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter ms_handle_connect 0x7f39e80629e0 2021-02-06T22:53:41.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:41.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368536466 0 0) 0x7f39e8095160 con 0x7f39e80629e0 2021-02-06T22:53:41.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c8004bd0 con 0x7f39e80629e0 2021-02-06T22:53:41.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063339655 0 0) 0x7f39e8097aa0 con 0x7f39e80999a0 2021-02-06T22:53:41.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8095160 con 0x7f39e80999a0 2021-02-06T22:53:41.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter ms_handle_connect 0x7f39e80928d0 2021-02-06T22:53:41.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:41.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39eca66700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.106:6789/0 conn(0x7f39e80928d0 legacy=0x7f39e812f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:41.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 283801652 0 0) 0x7f39e8095160 con 0x7f39e80999a0 2021-02-06T22:53:41.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39eda68700 1 --1- 172.21.15.51:0/3382474482 >> v1:172.21.15.51:6790/0 conn(0x7f39e80999a0 0x7f39e813d940 :-1 s=OPENED pgs=153 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f39e0001ef0 mon_map magic: 0 v1 2021-02-06T22:53:41.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39e8097aa0 con 0x7f39e80999a0 2021-02-06T22:53:41.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1810504826 0 0) 0x7f39c8004bd0 con 0x7f39e80629e0 2021-02-06T22:53:41.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39e8095160 con 0x7f39e80629e0 2021-02-06T22:53:41.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39dc001bb0 con 0x7f39e80629e0 2021-02-06T22:53:41.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126795178 0 0) 0x7f39e8116440 con 0x7f39e80928d0 2021-02-06T22:53:41.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c8004bd0 con 0x7f39e80928d0 2021-02-06T22:53:41.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39e0001ef0 con 0x7f39e80999a0 2021-02-06T22:53:41.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2814110629 0 0) 0x7f39e8095160 con 0x7f39e80629e0 2021-02-06T22:53:41.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.51:6790/0 conn(0x7f39e80999a0 legacy=0x7f39e813d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.106:6789/0 conn(0x7f39e80928d0 legacy=0x7f39e812f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e812fc40 con 0x7f39e80629e0 2021-02-06T22:53:41.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2473272934 0 0) 0x7f39e8097aa0 con 0x7f39e80999a0 2021-02-06T22:53:41.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e8115a40 con 0x7f39e80629e0 2021-02-06T22:53:41.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39ef4cb700 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:41.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e8114400 con 0x7f39e80629e0 2021-02-06T22:53:41.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.608+0000 7f39ef4cb700 1 librados: init done 2021-02-06T22:53:41.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f39dc004860 con 0x7f39e80629e0 2021-02-06T22:53:41.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39dc004b70 con 0x7f39e80629e0 2021-02-06T22:53:41.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f39dc004d50 con 0x7f39e80629e0 2021-02-06T22:53:41.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f39dc039510 con 0x7f39e80629e0 2021-02-06T22:53:41.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 10 client.4440.objecter ms_dispatch 0x7f39e8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:41.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 3 client.4440.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:41.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 3 client.4440.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:41.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39d97fa700 20 client.4440.objecter dump_active .. 0 homeless 2021-02-06T22:53:41.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.609+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c0004d60 con 0x7f39e80629e0 2021-02-06T22:53:41.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.612+0000 7f39d97fa700 10 client.4440.objecter ms_handle_connect 0x7f39c8030700 2021-02-06T22:53:41.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.613+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f39dc012400 con 0x7f39e80629e0 2021-02-06T22:53:41.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.861+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39c00059b0 con 0x7f39e80629e0 2021-02-06T22:53:41.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.861+0000 7f39d97fa700 1 -- 172.21.15.51:0/3382474482 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f39dc011ff0 con 0x7f39e80629e0 2021-02-06T22:53:41.861 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:41.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.862+0000 7f39ef4cb700 10 librados: watch_flush enter 2021-02-06T22:53:41.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.862+0000 7f39ef4cb700 10 librados: watch_flush exit 2021-02-06T22:53:41.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.862+0000 7f39ef4cb700 20 client.4440.objecter shutdown clearing up homeless session... 2021-02-06T22:53:41.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.862+0000 7f39ef4cb700 10 client.4440.objecter successfully canceled tick 2021-02-06T22:53:41.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.862+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.106:6812/33219 conn(0x7f39c8030700 legacy=0x7f39c8032bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 >> v1:172.21.15.51:6789/0 conn(0x7f39e80629e0 legacy=0x7f39e8135a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:41.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 shutdown_connections 2021-02-06T22:53:41.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 >> 172.21.15.51:0/3382474482 conn(0x7f39e8096860 msgr2=0x7f39e808ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:41.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 shutdown_connections 2021-02-06T22:53:41.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 -- 172.21.15.51:0/3382474482 wait complete. 2021-02-06T22:53:41.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:41.863+0000 7f39ef4cb700 1 librados: shutdown 2021-02-06T22:53:41.873 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:44.874 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:45.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.008+0000 7f178e8f4700 1 Processor -- start 2021-02-06T22:53:45.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f178e8f4700 1 -- start start 2021-02-06T22:53:45.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f178e8f4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880947b0 con 0x7f1788093580 2021-02-06T22:53:45.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f178e8f4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1788095a60 con 0x7f1788093a30 2021-02-06T22:53:45.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f178e8f4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1788095d00 con 0x7f17880605a0 2021-02-06T22:53:45.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f1787fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f17880605a0 0x7f1788092e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60248/0 (socket says 172.21.15.51:60248) 2021-02-06T22:53:45.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f1787fff700 1 -- 172.21.15.51:0/399265215 learned_addr learned my addr 172.21.15.51:0/399265215 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:45.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.009+0000 7f17877fe700 1 --1- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 0x7f178812f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59910/0 (socket says 172.21.15.51:59910) 2021-02-06T22:53:45.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.011+0000 7f17877fe700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 legacy=0x7f178812f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.011+0000 7f1787fff700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6790/0 conn(0x7f17880605a0 legacy=0x7f1788092e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458873287 0 0) 0x7f17880947b0 con 0x7f1788093580 2021-02-06T22:53:45.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1774003230 con 0x7f1788093580 2021-02-06T22:53:45.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593970926 0 0) 0x7f1788095d00 con 0x7f17880605a0 2021-02-06T22:53:45.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17880947b0 con 0x7f17880605a0 2021-02-06T22:53:45.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f178ce91700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.106:6789/0 conn(0x7f1788093a30 legacy=0x7f1788132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3786277065 0 0) 0x7f1774003230 con 0x7f1788093580 2021-02-06T22:53:45.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6790/0 conn(0x7f17880605a0 legacy=0x7f1788092e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.106:6789/0 conn(0x7f1788093a30 legacy=0x7f1788132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788095fa0 con 0x7f1788093580 2021-02-06T22:53:45.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1778001930 con 0x7f1788093580 2021-02-06T22:53:45.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f17877fe700 1 --1- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 0x7f178812f7b0 :-1 s=OPENED pgs=159 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f1778004690 mon_map magic: 0 v1 2021-02-06T22:53:45.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1778001c40 con 0x7f1788093580 2021-02-06T22:53:45.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f178e8f4700 1 -- 172.21.15.51:0/399265215 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 legacy=0x7f178812f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.012+0000 7f1786ffd700 1 -- 172.21.15.51:0/399265215 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1778004690 con 0x7f1788093580 2021-02-06T22:53:45.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 -- 172.21.15.51:0/399265215 shutdown_connections 2021-02-06T22:53:45.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 -- 172.21.15.51:0/399265215 >> 172.21.15.51:0/399265215 conn(0x7f1788097290 msgr2=0x7f1788099ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:45.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 -- 172.21.15.51:0/399265215 shutdown_connections 2021-02-06T22:53:45.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 -- 172.21.15.51:0/399265215 wait complete. 2021-02-06T22:53:45.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 librados: starting msgr at 2021-02-06T22:53:45.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 librados: starting objecter 2021-02-06T22:53:45.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.013+0000 7f178e8f4700 1 Processor -- start 2021-02-06T22:53:45.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 -- start start 2021-02-06T22:53:45.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 librados: setting wanted keys 2021-02-06T22:53:45.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 librados: calling monclient init 2021-02-06T22:53:45.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178812bc20 con 0x7f1788093580 2021-02-06T22:53:45.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178812bec0 con 0x7f1788093a30 2021-02-06T22:53:45.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178e8f4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178812b600 con 0x7f1788132d70 2021-02-06T22:53:45.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f1787fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 0x7f1788132660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59912/0 (socket says 172.21.15.51:59912) 2021-02-06T22:53:45.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f1787fff700 1 -- 172.21.15.51:0/2130355481 learned_addr learned my addr 172.21.15.51:0/2130355481 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:45.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.014+0000 7f178ce91700 1 --1- 172.21.15.51:0/2130355481 >> v1:172.21.15.51:6790/0 conn(0x7f1788132d70 0x7f1788142280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60258/0 (socket says 172.21.15.51:60258) 2021-02-06T22:53:45.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f178ce91700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.51:6790/0 conn(0x7f1788132d70 legacy=0x7f1788142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f1787fff700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 legacy=0x7f1788132660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 10 client.?.objecter ms_handle_connect 0x7f1788132d70 2021-02-06T22:53:45.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:45.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 10 client.?.objecter ms_handle_connect 0x7f1788093580 2021-02-06T22:53:45.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:45.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48979678 0 0) 0x7f178812b600 con 0x7f1788132d70 2021-02-06T22:53:45.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.016+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1768004bd0 con 0x7f1788132d70 2021-02-06T22:53:45.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85815752 0 0) 0x7f178812bc20 con 0x7f1788093580 2021-02-06T22:53:45.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178812b600 con 0x7f1788093580 2021-02-06T22:53:45.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f17877fe700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.106:6789/0 conn(0x7f1788093a30 legacy=0x7f178813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:45.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 10 client.?.objecter ms_handle_connect 0x7f1788093a30 2021-02-06T22:53:45.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:45.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 492876000 0 0) 0x7f1768004bd0 con 0x7f1788132d70 2021-02-06T22:53:45.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f178812bc20 con 0x7f1788132d70 2021-02-06T22:53:45.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1780001f20 con 0x7f1788132d70 2021-02-06T22:53:45.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3892310349 0 0) 0x7f178812b600 con 0x7f1788093580 2021-02-06T22:53:45.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1768004bd0 con 0x7f1788093580 2021-02-06T22:53:45.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f177c001d30 con 0x7f1788093580 2021-02-06T22:53:45.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269049172 0 0) 0x7f178812bec0 con 0x7f1788093a30 2021-02-06T22:53:45.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178812b600 con 0x7f1788093a30 2021-02-06T22:53:45.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2783483656 0 0) 0x7f178812bc20 con 0x7f1788132d70 2021-02-06T22:53:45.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.106:6789/0 conn(0x7f1788093a30 legacy=0x7f178813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.51:6789/0 conn(0x7f1788093580 legacy=0x7f1788132660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788126ee0 con 0x7f1788132d70 2021-02-06T22:53:45.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178813a5b0 con 0x7f1788132d70 2021-02-06T22:53:45.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f178e8f4700 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:45.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788134e60 con 0x7f1788132d70 2021-02-06T22:53:45.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f178e8f4700 1 librados: init done 2021-02-06T22:53:45.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1780002660 con 0x7f1788132d70 2021-02-06T22:53:45.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.017+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1780002970 con 0x7f1788132d70 2021-02-06T22:53:45.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f1780002b50 con 0x7f1788132d70 2021-02-06T22:53:45.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760004d60 con 0x7f1788132d70 2021-02-06T22:53:45.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f1780039740 con 0x7f1788132d70 2021-02-06T22:53:45.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 10 client.4433.objecter ms_dispatch 0x7f1788001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:45.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 3 client.4433.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:45.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 3 client.4433.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:45.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.018+0000 7f176ffff700 20 client.4433.objecter dump_active .. 0 homeless 2021-02-06T22:53:45.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.021+0000 7f176ffff700 10 client.4433.objecter ms_handle_connect 0x7f1768030720 2021-02-06T22:53:45.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.022+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f1780012420 con 0x7f1788132d70 2021-02-06T22:53:45.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.271+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f17600059b0 con 0x7f1788132d70 2021-02-06T22:53:45.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.271+0000 7f176ffff700 1 -- 172.21.15.51:0/2130355481 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f1780012420 con 0x7f1788132d70 2021-02-06T22:53:45.272 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:45.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 10 librados: watch_flush enter 2021-02-06T22:53:45.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 10 librados: watch_flush exit 2021-02-06T22:53:45.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 20 client.4433.objecter shutdown clearing up homeless session... 2021-02-06T22:53:45.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 10 client.4433.objecter successfully canceled tick 2021-02-06T22:53:45.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.106:6812/33219 conn(0x7f1768030720 legacy=0x7f1768032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 >> v1:172.21.15.51:6790/0 conn(0x7f1788132d70 legacy=0x7f1788142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:45.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 shutdown_connections 2021-02-06T22:53:45.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 >> 172.21.15.51:0/2130355481 conn(0x7f17880605a0 msgr2=0x7f1788097910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:45.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 shutdown_connections 2021-02-06T22:53:45.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 -- 172.21.15.51:0/2130355481 wait complete. 2021-02-06T22:53:45.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:45.273+0000 7f178e8f4700 1 librados: shutdown 2021-02-06T22:53:45.284 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:48.286 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:48.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.421+0000 7fb8b8c94700 1 Processor -- start 2021-02-06T22:53:48.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.421+0000 7fb8b8c94700 1 -- start start 2021-02-06T22:53:48.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b8c94700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40998a0 con 0x7fb8b40976b0 2021-02-06T22:53:48.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b8c94700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4099b10 con 0x7fb8b4097200 2021-02-06T22:53:48.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b8c94700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4099db0 con 0x7fb8b4093e80 2021-02-06T22:53:48.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b2d9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb8b40976b0 0x7fb8b41331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59922/0 (socket says 172.21.15.51:59922) 2021-02-06T22:53:48.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b259c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 0x7fb8b41278b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60262/0 (socket says 172.21.15.51:60262) 2021-02-06T22:53:48.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.422+0000 7fb8b2d9d700 1 -- 172.21.15.51:0/2630954693 learned_addr learned my addr 172.21.15.51:0/2630954693 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:48.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b259c700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 legacy=0x7fb8b41278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b2d9d700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.51:6789/0 conn(0x7fb8b40976b0 legacy=0x7fb8b41331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179554429 0 0) 0x7fb8b4099db0 con 0x7fb8b4093e80 2021-02-06T22:53:48.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898003230 con 0x7fb8b4093e80 2021-02-06T22:53:48.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149212623 0 0) 0x7fb8b40998a0 con 0x7fb8b40976b0 2021-02-06T22:53:48.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b1d9b700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.106:6789/0 conn(0x7fb8b4097200 legacy=0x7fb8b412fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b4099db0 con 0x7fb8b40976b0 2021-02-06T22:53:48.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 610635774 0 0) 0x7fb898003230 con 0x7fb8b4093e80 2021-02-06T22:53:48.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.106:6789/0 conn(0x7fb8b4097200 legacy=0x7fb8b412fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.51:6789/0 conn(0x7fb8b40976b0 legacy=0x7fb8b41331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.424+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4127480 con 0x7fb8b4093e80 2021-02-06T22:53:48.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb8a4001970 con 0x7fb8b4093e80 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb8a4001c80 con 0x7fb8b4093e80 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b159a700 1 -- 172.21.15.51:0/2630954693 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb8a4004690 con 0x7fb8b4093e80 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b8c94700 1 -- 172.21.15.51:0/2630954693 >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 legacy=0x7fb8b41278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b8c94700 1 -- 172.21.15.51:0/2630954693 shutdown_connections 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b8c94700 1 -- 172.21.15.51:0/2630954693 >> 172.21.15.51:0/2630954693 conn(0x7fb8b409ae00 msgr2=0x7fb8b409d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:48.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b8c94700 1 -- 172.21.15.51:0/2630954693 shutdown_connections 2021-02-06T22:53:48.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.425+0000 7fb8b8c94700 1 -- 172.21.15.51:0/2630954693 wait complete. 2021-02-06T22:53:48.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 librados: starting msgr at 2021-02-06T22:53:48.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 librados: starting objecter 2021-02-06T22:53:48.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 Processor -- start 2021-02-06T22:53:48.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 -- start start 2021-02-06T22:53:48.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 librados: setting wanted keys 2021-02-06T22:53:48.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.426+0000 7fb8b8c94700 1 librados: calling monclient init 2021-02-06T22:53:48.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.427+0000 7fb8b8c94700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b40995a0 con 0x7fb8b40976b0 2021-02-06T22:53:48.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.427+0000 7fb8b8c94700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4122eb0 con 0x7fb8b4097200 2021-02-06T22:53:48.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.427+0000 7fb8b8c94700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b4120d40 con 0x7fb8b4093e80 2021-02-06T22:53:48.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.427+0000 7fb8b259c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 0x7fb8b41242e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60268/0 (socket says 172.21.15.51:60268) 2021-02-06T22:53:48.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.427+0000 7fb8b259c700 1 -- 172.21.15.51:0/468116583 learned_addr learned my addr 172.21.15.51:0/468116583 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:48.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8b259c700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 legacy=0x7fb8b41242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8b2d9d700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.51:6789/0 conn(0x7fb8b40976b0 legacy=0x7fb8b4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter ms_handle_connect 0x7fb8b4093e80 2021-02-06T22:53:48.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:48.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter ms_handle_connect 0x7fb8b40976b0 2021-02-06T22:53:48.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:48.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409779949 0 0) 0x7fb8b4120d40 con 0x7fb8b4093e80 2021-02-06T22:53:48.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb890004bd0 con 0x7fb8b4093e80 2021-02-06T22:53:48.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709054615 0 0) 0x7fb8b40995a0 con 0x7fb8b40976b0 2021-02-06T22:53:48.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8b1d9b700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.106:6789/0 conn(0x7fb8b4097200 legacy=0x7fb8b413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:48.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b4120d40 con 0x7fb8b40976b0 2021-02-06T22:53:48.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter ms_handle_connect 0x7fb8b4097200 2021-02-06T22:53:48.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:48.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146334779 0 0) 0x7fb8b4122eb0 con 0x7fb8b4097200 2021-02-06T22:53:48.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b40995a0 con 0x7fb8b4097200 2021-02-06T22:53:48.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 367427778 0 0) 0x7fb890004bd0 con 0x7fb8b4093e80 2021-02-06T22:53:48.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb8b4122eb0 con 0x7fb8b4093e80 2021-02-06T22:53:48.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb8a4001930 con 0x7fb8b4093e80 2021-02-06T22:53:48.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1391008542 0 0) 0x7fb8b4120d40 con 0x7fb8b40976b0 2021-02-06T22:53:48.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb890004bd0 con 0x7fb8b40976b0 2021-02-06T22:53:48.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb8ac001f80 con 0x7fb8b40976b0 2021-02-06T22:53:48.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1579800985 0 0) 0x7fb8b4122eb0 con 0x7fb8b4093e80 2021-02-06T22:53:48.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.429+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.106:6789/0 conn(0x7fb8b4097200 legacy=0x7fb8b413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.51:6789/0 conn(0x7fb8b40976b0 legacy=0x7fb8b4142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b41219b0 con 0x7fb8b4093e80 2021-02-06T22:53:48.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b41249f0 con 0x7fb8b4093e80 2021-02-06T22:53:48.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8b8c94700 10 client.4439.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:48.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b41202f0 con 0x7fb8b4093e80 2021-02-06T22:53:48.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8b8c94700 1 librados: init done 2021-02-06T22:53:48.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb8a4004da0 con 0x7fb8b4093e80 2021-02-06T22:53:48.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb8a4004f10 con 0x7fb8b4093e80 2021-02-06T22:53:48.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fb8a400d6d0 con 0x7fb8b4093e80 2021-02-06T22:53:48.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fb8a4039630 con 0x7fb8b4093e80 2021-02-06T22:53:48.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 10 client.4439.objecter ms_dispatch 0x7fb8b4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:48.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 3 client.4439.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:48.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.430+0000 7fb8a27fc700 3 client.4439.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:48.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.431+0000 7fb8a27fc700 20 client.4439.objecter dump_active .. 0 homeless 2021-02-06T22:53:48.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.431+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb894004d60 con 0x7fb8b4093e80 2021-02-06T22:53:48.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.433+0000 7fb8a27fc700 10 client.4439.objecter ms_handle_connect 0x7fb890030740 2021-02-06T22:53:48.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.435+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fb8a40125e0 con 0x7fb8b4093e80 2021-02-06T22:53:48.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.684+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb8940059b0 con 0x7fb8b4093e80 2021-02-06T22:53:48.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.684+0000 7fb8a27fc700 1 -- 172.21.15.51:0/468116583 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fb8a40121d0 con 0x7fb8b4093e80 2021-02-06T22:53:48.684 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:48.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.685+0000 7fb8b8c94700 10 librados: watch_flush enter 2021-02-06T22:53:48.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 10 librados: watch_flush exit 2021-02-06T22:53:48.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 20 client.4439.objecter shutdown clearing up homeless session... 2021-02-06T22:53:48.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 10 client.4439.objecter successfully canceled tick 2021-02-06T22:53:48.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.106:6812/33219 conn(0x7fb890030740 legacy=0x7fb890032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 >> v1:172.21.15.51:6790/0 conn(0x7fb8b4093e80 legacy=0x7fb8b41242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:48.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 shutdown_connections 2021-02-06T22:53:48.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 >> 172.21.15.51:0/468116583 conn(0x7fb8b409ae00 msgr2=0x7fb8b40951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:48.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 shutdown_connections 2021-02-06T22:53:48.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 -- 172.21.15.51:0/468116583 wait complete. 2021-02-06T22:53:48.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:48.686+0000 7fb8b8c94700 1 librados: shutdown 2021-02-06T22:53:48.697 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:51.698 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:51.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.832+0000 7f62dc623700 1 Processor -- start 2021-02-06T22:53:51.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.832+0000 7f62dc623700 1 -- start start 2021-02-06T22:53:51.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.833+0000 7f62dc623700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d40915d0 con 0x7f62d40928d0 2021-02-06T22:53:51.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.833+0000 7f62dc623700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d4091ac0 con 0x7f62d40999a0 2021-02-06T22:53:51.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.833+0000 7f62dc623700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d4091d60 con 0x7f62d40629e0 2021-02-06T22:53:51.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.833+0000 7f62d9bbe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f62d40629e0 0x7f62d4090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60280/0 (socket says 172.21.15.51:60280) 2021-02-06T22:53:51.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.833+0000 7f62d9bbe700 1 -- 172.21.15.51:0/684962009 learned_addr learned my addr 172.21.15.51:0/684962009 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:51.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.835+0000 7f62d9bbe700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.51:6790/0 conn(0x7f62d40629e0 legacy=0x7f62d4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.835+0000 7f62dabc0700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.51:6789/0 conn(0x7f62d40928d0 legacy=0x7f62d412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.835+0000 7f62da3bf700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.106:6789/0 conn(0x7f62d40999a0 legacy=0x7f62d40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.835+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294412694 0 0) 0x7f62d4091d60 con 0x7f62d40629e0 2021-02-06T22:53:51.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.835+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62bc003230 con 0x7f62d40629e0 2021-02-06T22:53:51.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591201963 0 0) 0x7f62d40915d0 con 0x7f62d40928d0 2021-02-06T22:53:51.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d4091d60 con 0x7f62d40928d0 2021-02-06T22:53:51.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363211209 0 0) 0x7f62d4091ac0 con 0x7f62d40999a0 2021-02-06T22:53:51.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d40915d0 con 0x7f62d40999a0 2021-02-06T22:53:51.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4067505166 0 0) 0x7f62bc003230 con 0x7f62d40629e0 2021-02-06T22:53:51.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.106:6789/0 conn(0x7f62d40999a0 legacy=0x7f62d40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:51.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.51:6789/0 conn(0x7f62d40928d0 legacy=0x7f62d412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:51.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4092000 con 0x7f62d40629e0 2021-02-06T22:53:51.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f62c4001930 con 0x7f62d40629e0 2021-02-06T22:53:51.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62c4001c40 con 0x7f62d40629e0 2021-02-06T22:53:51.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62d93bd700 1 -- 172.21.15.51:0/684962009 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f62c4004750 con 0x7f62d40629e0 2021-02-06T22:53:51.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62dc623700 1 -- 172.21.15.51:0/684962009 >> v1:172.21.15.51:6790/0 conn(0x7f62d40629e0 legacy=0x7f62d4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:51.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62dc623700 1 -- 172.21.15.51:0/684962009 shutdown_connections 2021-02-06T22:53:51.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.836+0000 7f62dc623700 1 -- 172.21.15.51:0/684962009 >> 172.21.15.51:0/684962009 conn(0x7f62d4096860 msgr2=0x7f62d4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:51.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 -- 172.21.15.51:0/684962009 shutdown_connections 2021-02-06T22:53:51.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 -- 172.21.15.51:0/684962009 wait complete. 2021-02-06T22:53:51.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 librados: starting msgr at 2021-02-06T22:53:51.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 librados: starting objecter 2021-02-06T22:53:51.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 Processor -- start 2021-02-06T22:53:51.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 -- start start 2021-02-06T22:53:51.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 librados: setting wanted keys 2021-02-06T22:53:51.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.837+0000 7f62dc623700 1 librados: calling monclient init 2021-02-06T22:53:51.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.838+0000 7f62dc623700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d41385c0 con 0x7f62d40999a0 2021-02-06T22:53:51.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.838+0000 7f62dc623700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d4094980 con 0x7f62d40629e0 2021-02-06T22:53:51.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.838+0000 7f62dc623700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d4118bc0 con 0x7f62d40928d0 2021-02-06T22:53:51.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.838+0000 7f62d9bbe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f62d40928d0 0x7f62d413ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60286/0 (socket says 172.21.15.51:60286) 2021-02-06T22:53:51.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.838+0000 7f62d9bbe700 1 -- 172.21.15.51:0/1602445708 learned_addr learned my addr 172.21.15.51:0/1602445708 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:51.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62d9bbe700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.51:6790/0 conn(0x7f62d40928d0 legacy=0x7f62d413ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter ms_handle_connect 0x7f62d40928d0 2021-02-06T22:53:51.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62dabc0700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.51:6789/0 conn(0x7f62d40999a0 legacy=0x7f62d4140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:51.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter ms_handle_connect 0x7f62d40999a0 2021-02-06T22:53:51.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:51.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025723099 0 0) 0x7f62d4118bc0 con 0x7f62d40928d0 2021-02-06T22:53:51.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62da3bf700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.106:6789/0 conn(0x7f62d40629e0 legacy=0x7f62d4137eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:51.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62dabc0700 1 --1- 172.21.15.51:0/1602445708 >> v1:172.21.15.51:6789/0 conn(0x7f62d40999a0 0x7f62d4140190 :-1 s=OPENED pgs=164 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f62d41385c0 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:53:51.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4004bd0 con 0x7f62d40928d0 2021-02-06T22:53:51.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter ms_handle_connect 0x7f62d40629e0 2021-02-06T22:53:51.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:51.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.840+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1988758966 0 0) 0x7f62b4004bd0 con 0x7f62d40928d0 2021-02-06T22:53:51.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62d4118bc0 con 0x7f62d40928d0 2021-02-06T22:53:51.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f62c40018f0 con 0x7f62d40928d0 2021-02-06T22:53:51.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554771955 0 0) 0x7f62d4094980 con 0x7f62d40629e0 2021-02-06T22:53:51.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4004bd0 con 0x7f62d40629e0 2021-02-06T22:53:51.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2058169 0 0) 0x7f62d4118bc0 con 0x7f62d40928d0 2021-02-06T22:53:51.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.106:6789/0 conn(0x7f62d40629e0 legacy=0x7f62d4137eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:51.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.51:6789/0 conn(0x7f62d40999a0 legacy=0x7f62d4140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:51.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4118e60 con 0x7f62d40928d0 2021-02-06T22:53:51.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474122878 0 0) 0x7f62d41385c0 con 0x7f62d40999a0 2021-02-06T22:53:51.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d40951c0 con 0x7f62d40928d0 2021-02-06T22:53:51.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62dc623700 10 client.4445.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:51.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d41307c0 con 0x7f62d40928d0 2021-02-06T22:53:51.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62dc623700 1 librados: init done 2021-02-06T22:53:51.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f62c4004d00 con 0x7f62d40928d0 2021-02-06T22:53:51.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f62c4005010 con 0x7f62d40928d0 2021-02-06T22:53:51.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.841+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f62c400d7d0 con 0x7f62d40928d0 2021-02-06T22:53:51.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f62c40395f0 con 0x7f62d40928d0 2021-02-06T22:53:51.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62c27fc700 10 client.4445.objecter ms_dispatch 0x7f62d4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:51.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62c27fc700 3 client.4445.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:51.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62c27fc700 3 client.4445.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:51.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8004d60 con 0x7f62d40928d0 2021-02-06T22:53:51.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.842+0000 7f62c27fc700 20 client.4445.objecter dump_active .. 0 homeless 2021-02-06T22:53:51.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.844+0000 7f62c27fc700 10 client.4445.objecter ms_handle_connect 0x7f62b4034830 2021-02-06T22:53:51.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:51.846+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f62c40124e0 con 0x7f62d40928d0 2021-02-06T22:53:52.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.095+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f62b80059b0 con 0x7f62d40928d0 2021-02-06T22:53:52.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.095+0000 7f62c27fc700 1 -- 172.21.15.51:0/1602445708 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f62c40120d0 con 0x7f62d40928d0 2021-02-06T22:53:52.096 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:52.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 10 librados: watch_flush enter 2021-02-06T22:53:52.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 10 librados: watch_flush exit 2021-02-06T22:53:52.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 20 client.4445.objecter shutdown clearing up homeless session... 2021-02-06T22:53:52.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 10 client.4445.objecter successfully canceled tick 2021-02-06T22:53:52.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.106:6812/33219 conn(0x7f62b4034830 legacy=0x7f62b4036cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:52.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 >> v1:172.21.15.51:6790/0 conn(0x7f62d40928d0 legacy=0x7f62d413ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:52.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 shutdown_connections 2021-02-06T22:53:52.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 >> 172.21.15.51:0/1602445708 conn(0x7f62d4096860 msgr2=0x7f62d40658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:52.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.096+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 shutdown_connections 2021-02-06T22:53:52.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.097+0000 7f62dc623700 1 -- 172.21.15.51:0/1602445708 wait complete. 2021-02-06T22:53:52.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:52.097+0000 7f62dc623700 1 librados: shutdown 2021-02-06T22:53:52.108 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:55.109 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:55.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.246+0000 7f17b25de700 1 Processor -- start 2021-02-06T22:53:55.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.246+0000 7f17b25de700 1 -- start start 2021-02-06T22:53:55.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.246+0000 7f17b25de700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac0915d0 con 0x7f17ac0629e0 2021-02-06T22:53:55.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.246+0000 7f17b25de700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac091ac0 con 0x7f17ac0999a0 2021-02-06T22:53:55.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.246+0000 7f17b25de700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac091d60 con 0x7f17ac0928d0 2021-02-06T22:53:55.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.247+0000 7f17ab7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 0x7f17ac090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59960/0 (socket says 172.21.15.51:59960) 2021-02-06T22:53:55.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.247+0000 7f17b0b7b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 0x7f17ac12fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60304/0 (socket says 172.21.15.51:60304) 2021-02-06T22:53:55.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.247+0000 7f17ab7fe700 1 -- 172.21.15.51:0/1578333589 learned_addr learned my addr 172.21.15.51:0/1578333589 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:55.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17b0b7b700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 legacy=0x7f17ac12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:55.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17ab7fe700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 legacy=0x7f17ac090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:55.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120833764 0 0) 0x7f17ac091d60 con 0x7f17ac0928d0 2021-02-06T22:53:55.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17abfff700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.106:6789/0 conn(0x7f17ac0999a0 legacy=0x7f17ac0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:55.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178c003230 con 0x7f17ac0928d0 2021-02-06T22:53:55.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138788420 0 0) 0x7f17ac0915d0 con 0x7f17ac0629e0 2021-02-06T22:53:55.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ac091d60 con 0x7f17ac0629e0 2021-02-06T22:53:55.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769432751 0 0) 0x7f17ac091ac0 con 0x7f17ac0999a0 2021-02-06T22:53:55.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ac0915d0 con 0x7f17ac0999a0 2021-02-06T22:53:55.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 316202703 0 0) 0x7f178c003230 con 0x7f17ac0928d0 2021-02-06T22:53:55.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.106:6789/0 conn(0x7f17ac0999a0 legacy=0x7f17ac0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 legacy=0x7f17ac090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac092000 con 0x7f17ac0928d0 2021-02-06T22:53:55.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f17a4001cb0 con 0x7f17ac0928d0 2021-02-06T22:53:55.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f17a4001fc0 con 0x7f17ac0928d0 2021-02-06T22:53:55.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.249+0000 7f17aaffd700 1 -- 172.21.15.51:0/1578333589 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f17a4004a10 con 0x7f17ac0928d0 2021-02-06T22:53:55.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.250+0000 7f17b25de700 1 -- 172.21.15.51:0/1578333589 >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 legacy=0x7f17ac12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.250+0000 7f17b25de700 1 -- 172.21.15.51:0/1578333589 shutdown_connections 2021-02-06T22:53:55.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.250+0000 7f17b25de700 1 -- 172.21.15.51:0/1578333589 >> 172.21.15.51:0/1578333589 conn(0x7f17ac096860 msgr2=0x7f17ac099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:55.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.250+0000 7f17b25de700 1 -- 172.21.15.51:0/1578333589 shutdown_connections 2021-02-06T22:53:55.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.250+0000 7f17b25de700 1 -- 172.21.15.51:0/1578333589 wait complete. 2021-02-06T22:53:55.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 librados: starting msgr at 2021-02-06T22:53:55.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 librados: starting objecter 2021-02-06T22:53:55.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 Processor -- start 2021-02-06T22:53:55.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 -- start start 2021-02-06T22:53:55.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 librados: setting wanted keys 2021-02-06T22:53:55.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 librados: calling monclient init 2021-02-06T22:53:55.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac095160 con 0x7f17ac0629e0 2021-02-06T22:53:55.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac11a660 con 0x7f17ac0999a0 2021-02-06T22:53:55.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17b25de700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac067530 con 0x7f17ac0928d0 2021-02-06T22:53:55.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.251+0000 7f17ab7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 0x7f17ac133750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60306/0 (socket says 172.21.15.51:60306) 2021-02-06T22:53:55.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.252+0000 7f17ab7fe700 1 -- 172.21.15.51:0/1103712587 learned_addr learned my addr 172.21.15.51:0/1103712587 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:55.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.252+0000 7f17abfff700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 legacy=0x7f17ac139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.252+0000 7f17abfff700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 legacy=0x7f17ac139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.252+0000 7f17abfff700 1 --1- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 0x7f17ac139c90 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.252+0000 7f17abfff700 1 --1- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 0x7f17ac139c90 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17ab7fe700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 legacy=0x7f17ac133750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 10 client.?.objecter ms_handle_connect 0x7f17ac0928d0 2021-02-06T22:53:55.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:55.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134625136 0 0) 0x7f17ac067530 con 0x7f17ac0928d0 2021-02-06T22:53:55.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1790004bd0 con 0x7f17ac0928d0 2021-02-06T22:53:55.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 10 client.?.objecter ms_handle_connect 0x7f17ac0999a0 2021-02-06T22:53:55.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:55.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17b0b7b700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.106:6789/0 conn(0x7f17ac0999a0 legacy=0x7f17ac141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:55.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1385498840 0 0) 0x7f1790004bd0 con 0x7f17ac0928d0 2021-02-06T22:53:55.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17ac067530 con 0x7f17ac0928d0 2021-02-06T22:53:55.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f179c0044f0 con 0x7f17ac0928d0 2021-02-06T22:53:55.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598389790 0 0) 0x7f17ac11a660 con 0x7f17ac0999a0 2021-02-06T22:53:55.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1790004bd0 con 0x7f17ac0999a0 2021-02-06T22:53:55.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2738804901 0 0) 0x7f17ac067530 con 0x7f17ac0928d0 2021-02-06T22:53:55.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.106:6789/0 conn(0x7f17ac0999a0 legacy=0x7f17ac141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6789/0 conn(0x7f17ac0629e0 legacy=0x7f17ac139c90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:53:55.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac133e60 con 0x7f17ac0928d0 2021-02-06T22:53:55.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac119c60 con 0x7f17ac0928d0 2021-02-06T22:53:55.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17b25de700 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:55.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac118620 con 0x7f17ac0928d0 2021-02-06T22:53:55.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17b25de700 1 librados: init done 2021-02-06T22:53:55.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f179c004a70 con 0x7f17ac0928d0 2021-02-06T22:53:55.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.254+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f179c004d80 con 0x7f17ac0928d0 2021-02-06T22:53:55.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f179c004f60 con 0x7f17ac0928d0 2021-02-06T22:53:55.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f179c039730 con 0x7f17ac0928d0 2021-02-06T22:53:55.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 10 client.4451.objecter ms_dispatch 0x7f17ac001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:55.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 3 client.4451.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:55.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 3 client.4451.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:55.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784004d60 con 0x7f17ac0928d0 2021-02-06T22:53:55.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.255+0000 7f17a3fff700 20 client.4451.objecter dump_active .. 0 homeless 2021-02-06T22:53:55.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.258+0000 7f17a3fff700 10 client.4451.objecter ms_handle_connect 0x7f17900303b0 2021-02-06T22:53:55.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.259+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f179c006460 con 0x7f17ac0928d0 2021-02-06T22:53:55.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.513+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f17840059b0 con 0x7f17ac0928d0 2021-02-06T22:53:55.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.514+0000 7f17a3fff700 1 -- 172.21.15.51:0/1103712587 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f179c012210 con 0x7f17ac0928d0 2021-02-06T22:53:55.515 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:55.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 10 librados: watch_flush enter 2021-02-06T22:53:55.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 10 librados: watch_flush exit 2021-02-06T22:53:55.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 20 client.4451.objecter shutdown clearing up homeless session... 2021-02-06T22:53:55.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 10 client.4451.objecter successfully canceled tick 2021-02-06T22:53:55.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.106:6812/33219 conn(0x7f17900303b0 legacy=0x7f1790032870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 >> v1:172.21.15.51:6790/0 conn(0x7f17ac0928d0 legacy=0x7f17ac133750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:55.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 shutdown_connections 2021-02-06T22:53:55.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 >> 172.21.15.51:0/1103712587 conn(0x7f17ac096860 msgr2=0x7f17ac064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:55.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 shutdown_connections 2021-02-06T22:53:55.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 -- 172.21.15.51:0/1103712587 wait complete. 2021-02-06T22:53:55.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:55.515+0000 7f17b25de700 1 librados: shutdown 2021-02-06T22:53:55.527 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:53:58.529 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:53:58.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a38b8700 1 Processor -- start 2021-02-06T22:53:58.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a38b8700 1 -- start start 2021-02-06T22:53:58.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a38b8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c095050 con 0x7fa59c0999a0 2021-02-06T22:53:58.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a38b8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c128c00 con 0x7fa59c067a30 2021-02-06T22:53:58.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a38b8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c095280 con 0x7fa59c067ec0 2021-02-06T22:53:58.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a1654700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa59c0999a0 0x7fa59c1284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59972/0 (socket says 172.21.15.51:59972) 2021-02-06T22:53:58.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.664+0000 7fa5a1654700 1 -- 172.21.15.51:0/2793294677 learned_addr learned my addr 172.21.15.51:0/2793294677 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:58.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa5a1e55700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.51:6790/0 conn(0x7fa59c067ec0 legacy=0x7fa59c130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa5a1654700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.51:6789/0 conn(0x7fa59c0999a0 legacy=0x7fa59c1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa5a0e53700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.106:6789/0 conn(0x7fa59c067a30 legacy=0x7fa59c12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982057557 0 0) 0x7fa59c095050 con 0x7fa59c0999a0 2021-02-06T22:53:58.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa584003230 con 0x7fa59c0999a0 2021-02-06T22:53:58.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394471975 0 0) 0x7fa59c095280 con 0x7fa59c067ec0 2021-02-06T22:53:58.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c095050 con 0x7fa59c067ec0 2021-02-06T22:53:58.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774565195 0 0) 0x7fa59c128c00 con 0x7fa59c067a30 2021-02-06T22:53:58.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c095280 con 0x7fa59c067a30 2021-02-06T22:53:58.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2846842085 0 0) 0x7fa584003230 con 0x7fa59c0999a0 2021-02-06T22:53:58.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.51:6790/0 conn(0x7fa59c067ec0 legacy=0x7fa59c130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.106:6789/0 conn(0x7fa59c067a30 legacy=0x7fa59c12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c095520 con 0x7fa59c0999a0 2021-02-06T22:53:58.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa590001930 con 0x7fa59c0999a0 2021-02-06T22:53:58.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa590001c40 con 0x7fa59c0999a0 2021-02-06T22:53:58.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.667+0000 7fa58ffff700 1 -- 172.21.15.51:0/2793294677 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa590004750 con 0x7fa59c0999a0 2021-02-06T22:53:58.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2793294677 >> v1:172.21.15.51:6789/0 conn(0x7fa59c0999a0 legacy=0x7fa59c1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2793294677 shutdown_connections 2021-02-06T22:53:58.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2793294677 >> 172.21.15.51:0/2793294677 conn(0x7fa59c096860 msgr2=0x7fa59c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:58.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2793294677 shutdown_connections 2021-02-06T22:53:58.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2793294677 wait complete. 2021-02-06T22:53:58.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 librados: starting msgr at 2021-02-06T22:53:58.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.668+0000 7fa5a38b8700 1 librados: starting objecter 2021-02-06T22:53:58.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 Processor -- start 2021-02-06T22:53:58.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 -- start start 2021-02-06T22:53:58.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 librados: setting wanted keys 2021-02-06T22:53:58.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 librados: calling monclient init 2021-02-06T22:53:58.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c066d00 con 0x7fa59c0999a0 2021-02-06T22:53:58.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c121a40 con 0x7fa59c067ec0 2021-02-06T22:53:58.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a38b8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c090a10 con 0x7fa59c067a30 2021-02-06T22:53:58.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a1654700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fa59c067a30 0x7fa59c065ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60320/0 (socket says 172.21.15.51:60320) 2021-02-06T22:53:58.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.669+0000 7fa5a1654700 1 -- 172.21.15.51:0/2814430047 learned_addr learned my addr 172.21.15.51:0/2814430047 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:53:58.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a1654700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.51:6790/0 conn(0x7fa59c067a30 legacy=0x7fa59c065ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a1e55700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.51:6789/0 conn(0x7fa59c0999a0 legacy=0x7fa59c142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter ms_handle_connect 0x7fa59c067a30 2021-02-06T22:53:58.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:58.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter ms_handle_connect 0x7fa59c0999a0 2021-02-06T22:53:58.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:58.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231420078 0 0) 0x7fa59c090a10 con 0x7fa59c067a30 2021-02-06T22:53:58.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa57c004bd0 con 0x7fa59c067a30 2021-02-06T22:53:58.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230350306 0 0) 0x7fa59c066d00 con 0x7fa59c0999a0 2021-02-06T22:53:58.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c090a10 con 0x7fa59c0999a0 2021-02-06T22:53:58.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter ms_handle_connect 0x7fa59c067ec0 2021-02-06T22:53:58.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:53:58.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a0e53700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.106:6789/0 conn(0x7fa59c067ec0 legacy=0x7fa59c0665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:53:58.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 624160630 0 0) 0x7fa57c004bd0 con 0x7fa59c067a30 2021-02-06T22:53:58.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa59c066d00 con 0x7fa59c067a30 2021-02-06T22:53:58.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa5900018f0 con 0x7fa59c067a30 2021-02-06T22:53:58.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3688953386 0 0) 0x7fa59c090a10 con 0x7fa59c0999a0 2021-02-06T22:53:58.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa57c004bd0 con 0x7fa59c0999a0 2021-02-06T22:53:58.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa594001fd0 con 0x7fa59c0999a0 2021-02-06T22:53:58.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198891365 0 0) 0x7fa59c121a40 con 0x7fa59c067ec0 2021-02-06T22:53:58.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c090a10 con 0x7fa59c067ec0 2021-02-06T22:53:58.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 268083454 0 0) 0x7fa59c066d00 con 0x7fa59c067a30 2021-02-06T22:53:58.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.106:6789/0 conn(0x7fa59c067ec0 legacy=0x7fa59c0665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.51:6789/0 conn(0x7fa59c0999a0 legacy=0x7fa59c142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c090cb0 con 0x7fa59c067a30 2021-02-06T22:53:58.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c1200d0 con 0x7fa59c067a30 2021-02-06T22:53:58.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a38b8700 10 client.4457.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:53:58.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c120b40 con 0x7fa59c067a30 2021-02-06T22:53:58.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa5a38b8700 1 librados: init done 2021-02-06T22:53:58.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa590001560 con 0x7fa59c067a30 2021-02-06T22:53:58.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.672+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa590004f60 con 0x7fa59c067a30 2021-02-06T22:53:58.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fa59000d720 con 0x7fa59c067a30 2021-02-06T22:53:58.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fa590039710 con 0x7fa59c067a30 2021-02-06T22:53:58.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 10 client.4457.objecter ms_dispatch 0x7fa59c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:53:58.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 3 client.4457.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:53:58.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 3 client.4457.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:53:58.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa58d7fa700 20 client.4457.objecter dump_active .. 0 homeless 2021-02-06T22:53:58.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.673+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa574004d60 con 0x7fa59c067a30 2021-02-06T22:53:58.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.676+0000 7fa58d7fa700 10 client.4457.objecter ms_handle_connect 0x7fa57c030720 2021-02-06T22:53:58.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.677+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fa590012670 con 0x7fa59c067a30 2021-02-06T22:53:58.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.926+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa5740059b0 con 0x7fa59c067a30 2021-02-06T22:53:58.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.926+0000 7fa58d7fa700 1 -- 172.21.15.51:0/2814430047 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fa590012260 con 0x7fa59c067a30 2021-02-06T22:53:58.927 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:53:58.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 10 librados: watch_flush enter 2021-02-06T22:53:58.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 10 librados: watch_flush exit 2021-02-06T22:53:58.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 20 client.4457.objecter shutdown clearing up homeless session... 2021-02-06T22:53:58.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 10 client.4457.objecter successfully canceled tick 2021-02-06T22:53:58.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.106:6812/33219 conn(0x7fa57c030720 legacy=0x7fa57c032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 >> v1:172.21.15.51:6790/0 conn(0x7fa59c067a30 legacy=0x7fa59c065ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:53:58.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 shutdown_connections 2021-02-06T22:53:58.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 >> 172.21.15.51:0/2814430047 conn(0x7fa59c096860 msgr2=0x7fa59c097d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:53:58.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 shutdown_connections 2021-02-06T22:53:58.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 -- 172.21.15.51:0/2814430047 wait complete. 2021-02-06T22:53:58.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:53:58.928+0000 7fa5a38b8700 1 librados: shutdown 2021-02-06T22:53:58.939 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:01.940 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:02.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.075+0000 7f6196318700 1 Processor -- start 2021-02-06T22:54:02.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.075+0000 7f6196318700 1 -- start start 2021-02-06T22:54:02.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f6196318700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6190095440 con 0x7f619012ce00 2021-02-06T22:54:02.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f6196318700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61900907b0 con 0x7f619008fa70 2021-02-06T22:54:02.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f6196318700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6190091010 con 0x7f6190092bf0 2021-02-06T22:54:02.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f618f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 0x7f61900930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60330/0 (socket says 172.21.15.51:60330) 2021-02-06T22:54:02.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f618f7fe700 1 -- 172.21.15.51:0/1339440508 learned_addr learned my addr 172.21.15.51:0/1339440508 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:02.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.076+0000 7f61948b5700 1 --1- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6789/0 conn(0x7f619012ce00 0x7f619012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:59990/0 (socket says 172.21.15.51:59990) 2021-02-06T22:54:02.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f61948b5700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6789/0 conn(0x7f619012ce00 legacy=0x7f619012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618f7fe700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 legacy=0x7f61900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618f7fe700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 legacy=0x7f61900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2021-02-06T22:54:02.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618f7fe700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 legacy=0x7f61900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:54:02.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618f7fe700 1 --1- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 0x7f61900930a0 :-1 s=OPENED pgs=164 cs=1 l=1).handle_message read tag failed 2021-02-06T22:54:02.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618f7fe700 1 --1- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 0x7f61900930a0 :-1 s=OPENED pgs=164 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:54:02.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618ffff700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.106:6789/0 conn(0x7f619008fa70 legacy=0x7f61900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.078+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040680412 0 0) 0x7f6190095440 con 0x7f619012ce00 2021-02-06T22:54:02.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f617c003230 con 0x7f619012ce00 2021-02-06T22:54:02.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3188504086 0 0) 0x7f617c003230 con 0x7f619012ce00 2021-02-06T22:54:02.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6790/0 conn(0x7f6190092bf0 legacy=0x7f61900930a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:54:02.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.106:6789/0 conn(0x7f619008fa70 legacy=0x7f61900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61900912b0 con 0x7f619012ce00 2021-02-06T22:54:02.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6188001cb0 con 0x7f619012ce00 2021-02-06T22:54:02.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6188001fc0 con 0x7f619012ce00 2021-02-06T22:54:02.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f618effd700 1 -- 172.21.15.51:0/1339440508 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6188004a10 con 0x7f619012ce00 2021-02-06T22:54:02.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f6196318700 1 -- 172.21.15.51:0/1339440508 >> v1:172.21.15.51:6789/0 conn(0x7f619012ce00 legacy=0x7f619012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f6196318700 1 -- 172.21.15.51:0/1339440508 shutdown_connections 2021-02-06T22:54:02.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f6196318700 1 -- 172.21.15.51:0/1339440508 >> 172.21.15.51:0/1339440508 conn(0x7f6190096860 msgr2=0x7f6190099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:02.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f6196318700 1 -- 172.21.15.51:0/1339440508 shutdown_connections 2021-02-06T22:54:02.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.079+0000 7f6196318700 1 -- 172.21.15.51:0/1339440508 wait complete. 2021-02-06T22:54:02.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 librados: starting msgr at 2021-02-06T22:54:02.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 librados: starting objecter 2021-02-06T22:54:02.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 Processor -- start 2021-02-06T22:54:02.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 -- start start 2021-02-06T22:54:02.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 librados: setting wanted keys 2021-02-06T22:54:02.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.080+0000 7f6196318700 1 librados: calling monclient init 2021-02-06T22:54:02.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.081+0000 7f6196318700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6190090bf0 con 0x7f619012ce00 2021-02-06T22:54:02.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.081+0000 7f6196318700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619012c900 con 0x7f6190092bf0 2021-02-06T22:54:02.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.081+0000 7f6196318700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6190116960 con 0x7f619008fa70 2021-02-06T22:54:02.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.081+0000 7f618ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f619008fa70 0x7f6190113430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60334/0 (socket says 172.21.15.51:60334) 2021-02-06T22:54:02.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.081+0000 7f618ffff700 1 -- 172.21.15.51:0/2881070549 learned_addr learned my addr 172.21.15.51:0/2881070549 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:02.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f618ffff700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.51:6790/0 conn(0x7f619008fa70 legacy=0x7f6190113430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter ms_handle_connect 0x7f619008fa70 2021-02-06T22:54:02.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f61948b5700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.51:6789/0 conn(0x7f619012ce00 legacy=0x7f619013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:02.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter ms_handle_connect 0x7f619012ce00 2021-02-06T22:54:02.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:02.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter ms_handle_connect 0x7f6190092bf0 2021-02-06T22:54:02.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:02.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f618f7fe700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.106:6789/0 conn(0x7f6190092bf0 legacy=0x7f619012c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:02.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828955988 0 0) 0x7f6190116960 con 0x7f619008fa70 2021-02-06T22:54:02.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6170004bd0 con 0x7f619008fa70 2021-02-06T22:54:02.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223889285 0 0) 0x7f6190090bf0 con 0x7f619012ce00 2021-02-06T22:54:02.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6190116960 con 0x7f619012ce00 2021-02-06T22:54:02.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.083+0000 7f618f7fe700 1 --1- 172.21.15.51:0/2881070549 >> v1:172.21.15.106:6789/0 conn(0x7f6190092bf0 0x7f619012c1f0 :-1 s=OPENED pgs=158 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f619012c900 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:54:02.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 637434658 0 0) 0x7f6170004bd0 con 0x7f619008fa70 2021-02-06T22:54:02.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6190090bf0 con 0x7f619008fa70 2021-02-06T22:54:02.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6180001be0 con 0x7f619008fa70 2021-02-06T22:54:02.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3584091524 0 0) 0x7f6190116960 con 0x7f619012ce00 2021-02-06T22:54:02.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6170004bd0 con 0x7f619012ce00 2021-02-06T22:54:02.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6188001c70 con 0x7f619012ce00 2021-02-06T22:54:02.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 726244559 0 0) 0x7f6190090bf0 con 0x7f619008fa70 2021-02-06T22:54:02.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.106:6789/0 conn(0x7f6190092bf0 legacy=0x7f619012c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.51:6789/0 conn(0x7f619012ce00 legacy=0x7f619013da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190116c00 con 0x7f619008fa70 2021-02-06T22:54:02.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991058280 0 0) 0x7f619012c900 con 0x7f6190092bf0 2021-02-06T22:54:02.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6190115730 con 0x7f619008fa70 2021-02-06T22:54:02.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6196318700 10 client.4460.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:02.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6190114100 con 0x7f619008fa70 2021-02-06T22:54:02.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.084+0000 7f6196318700 1 librados: init done 2021-02-06T22:54:02.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61901158c0 con 0x7f619008fa70 2021-02-06T22:54:02.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f61800022d0 con 0x7f619008fa70 2021-02-06T22:54:02.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f61800025e0 con 0x7f619008fa70 2021-02-06T22:54:02.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f6180002740 con 0x7f619008fa70 2021-02-06T22:54:02.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f6180039440 con 0x7f619008fa70 2021-02-06T22:54:02.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 10 client.4460.objecter ms_dispatch 0x7f6190001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:02.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 3 client.4460.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:02.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 3 client.4460.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:02.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.085+0000 7f6177fff700 20 client.4460.objecter dump_active .. 0 homeless 2021-02-06T22:54:02.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.088+0000 7f6177fff700 10 client.4460.objecter ms_handle_connect 0x7f6170030560 2021-02-06T22:54:02.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.089+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f61800120a0 con 0x7f619008fa70 2021-02-06T22:54:02.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.339+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f61900581b0 con 0x7f619008fa70 2021-02-06T22:54:02.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.339+0000 7f6177fff700 1 -- 172.21.15.51:0/2881070549 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f6180011ec0 con 0x7f619008fa70 2021-02-06T22:54:02.340 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:02.341 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 10 librados: watch_flush enter 2021-02-06T22:54:02.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 10 librados: watch_flush exit 2021-02-06T22:54:02.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 20 client.4460.objecter shutdown clearing up homeless session... 2021-02-06T22:54:02.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 10 client.4460.objecter successfully canceled tick 2021-02-06T22:54:02.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.106:6812/33219 conn(0x7f6170030560 legacy=0x7f6170032a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 >> v1:172.21.15.51:6790/0 conn(0x7f619008fa70 legacy=0x7f6190113430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:02.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 shutdown_connections 2021-02-06T22:54:02.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 >> 172.21.15.51:0/2881070549 conn(0x7f6190096860 msgr2=0x7f61900663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:02.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 shutdown_connections 2021-02-06T22:54:02.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 -- 172.21.15.51:0/2881070549 wait complete. 2021-02-06T22:54:02.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:02.341+0000 7f6196318700 1 librados: shutdown 2021-02-06T22:54:02.352 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:05.353 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:05.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.488+0000 7f371eb24700 1 Processor -- start 2021-02-06T22:54:05.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f371eb24700 1 -- start start 2021-02-06T22:54:05.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f371eb24700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37180670d0 con 0x7f3718063740 2021-02-06T22:54:05.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f371eb24700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3718064490 con 0x7f3718098810 2021-02-06T22:54:05.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f371eb24700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3718064730 con 0x7f3718098360 2021-02-06T22:54:05.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f3717fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3718098360 0x7f371812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60342/0 (socket says 172.21.15.51:60342) 2021-02-06T22:54:05.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f371c8c0700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3718063740 0x7f3718127490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60000/0 (socket says 172.21.15.51:60000) 2021-02-06T22:54:05.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.489+0000 7f3717fff700 1 -- 172.21.15.51:0/523403753 learned_addr learned my addr 172.21.15.51:0/523403753 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:05.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.491+0000 7f371c8c0700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.51:6789/0 conn(0x7f3718063740 legacy=0x7f3718127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.491+0000 7f3717fff700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.51:6790/0 conn(0x7f3718098360 legacy=0x7f371812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216456184 0 0) 0x7f37180670d0 con 0x7f3718063740 2021-02-06T22:54:05.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f371d0c1700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.106:6789/0 conn(0x7f3718098810 legacy=0x7f3718132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003230 con 0x7f3718063740 2021-02-06T22:54:05.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285489388 0 0) 0x7f3718064730 con 0x7f3718098360 2021-02-06T22:54:05.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37180670d0 con 0x7f3718098360 2021-02-06T22:54:05.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428826974 0 0) 0x7f3718064490 con 0x7f3718098810 2021-02-06T22:54:05.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3718064730 con 0x7f3718098810 2021-02-06T22:54:05.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3949077919 0 0) 0x7f36fc003230 con 0x7f3718063740 2021-02-06T22:54:05.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.51:6790/0 conn(0x7f3718098360 legacy=0x7f371812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.106:6789/0 conn(0x7f3718098810 legacy=0x7f3718132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180649d0 con 0x7f3718063740 2021-02-06T22:54:05.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f370c001930 con 0x7f3718063740 2021-02-06T22:54:05.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f370c001c40 con 0x7f3718063740 2021-02-06T22:54:05.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.492+0000 7f37177fe700 1 -- 172.21.15.51:0/523403753 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f370c004690 con 0x7f3718063740 2021-02-06T22:54:05.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 -- 172.21.15.51:0/523403753 >> v1:172.21.15.51:6789/0 conn(0x7f3718063740 legacy=0x7f3718127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 -- 172.21.15.51:0/523403753 shutdown_connections 2021-02-06T22:54:05.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 -- 172.21.15.51:0/523403753 >> 172.21.15.51:0/523403753 conn(0x7f371809b5e0 msgr2=0x7f371809b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:05.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 -- 172.21.15.51:0/523403753 shutdown_connections 2021-02-06T22:54:05.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 -- 172.21.15.51:0/523403753 wait complete. 2021-02-06T22:54:05.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 librados: starting msgr at 2021-02-06T22:54:05.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 librados: starting objecter 2021-02-06T22:54:05.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.493+0000 7f371eb24700 1 Processor -- start 2021-02-06T22:54:05.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 -- start start 2021-02-06T22:54:05.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 librados: setting wanted keys 2021-02-06T22:54:05.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 librados: calling monclient init 2021-02-06T22:54:05.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371812de00 con 0x7f3718098360 2021-02-06T22:54:05.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371812e030 con 0x7f3718098810 2021-02-06T22:54:05.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371eb24700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371812e2d0 con 0x7f3718063740 2021-02-06T22:54:05.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371c8c0700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3718063740 0x7f3718139940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60346/0 (socket says 172.21.15.51:60346) 2021-02-06T22:54:05.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f3717fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3718098360 0x7f37181337c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60006/0 (socket says 172.21.15.51:60006) 2021-02-06T22:54:05.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.494+0000 7f371c8c0700 1 -- 172.21.15.51:0/1338326188 learned_addr learned my addr 172.21.15.51:0/1338326188 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:05.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f3717fff700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.51:6789/0 conn(0x7f3718098360 legacy=0x7f37181337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f371c8c0700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.51:6790/0 conn(0x7f3718063740 legacy=0x7f3718139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f3714ff9700 10 client.?.objecter ms_handle_connect 0x7f3718098360 2021-02-06T22:54:05.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f3714ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:05.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f3714ff9700 10 client.?.objecter ms_handle_connect 0x7f3718063740 2021-02-06T22:54:05.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.496+0000 7f3714ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:05.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179513207 0 0) 0x7f371812de00 con 0x7f3718098360 2021-02-06T22:54:05.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f8004bd0 con 0x7f3718098360 2021-02-06T22:54:05.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372307669 0 0) 0x7f371812e2d0 con 0x7f3718063740 2021-02-06T22:54:05.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371812de00 con 0x7f3718063740 2021-02-06T22:54:05.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 10 client.?.objecter ms_handle_connect 0x7f3718098810 2021-02-06T22:54:05.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:05.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f371d0c1700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.106:6789/0 conn(0x7f3718098810 legacy=0x7f3718141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:05.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2093230813 0 0) 0x7f36f8004bd0 con 0x7f3718098360 2021-02-06T22:54:05.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f371812e2d0 con 0x7f3718098360 2021-02-06T22:54:05.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3704001c60 con 0x7f3718098360 2021-02-06T22:54:05.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 251885903 0 0) 0x7f371812de00 con 0x7f3718063740 2021-02-06T22:54:05.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f36f8004bd0 con 0x7f3718063740 2021-02-06T22:54:05.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f370c0018f0 con 0x7f3718063740 2021-02-06T22:54:05.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074999701 0 0) 0x7f371812e030 con 0x7f3718098810 2021-02-06T22:54:05.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f371812de00 con 0x7f3718098810 2021-02-06T22:54:05.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3429595857 0 0) 0x7f371812e2d0 con 0x7f3718098360 2021-02-06T22:54:05.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.51:6790/0 conn(0x7f3718063740 legacy=0x7f3718139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.106:6789/0 conn(0x7f3718098810 legacy=0x7f3718141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3718063cb0 con 0x7f3718098360 2021-02-06T22:54:05.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371812c0f0 con 0x7f3718098360 2021-02-06T22:54:05.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f371eb24700 10 client.4479.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:05.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3718133ed0 con 0x7f3718098360 2021-02-06T22:54:05.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f371eb24700 1 librados: init done 2021-02-06T22:54:05.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f37040048e0 con 0x7f3718098360 2021-02-06T22:54:05.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.497+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3704004bf0 con 0x7f3718098360 2021-02-06T22:54:05.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3704004d50 con 0x7f3718098360 2021-02-06T22:54:05.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3704039520 con 0x7f3718098360 2021-02-06T22:54:05.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 10 client.4479.objecter ms_dispatch 0x7f3718001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:05.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 3 client.4479.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:05.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 3 client.4479.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:05.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f3714ff9700 20 client.4479.objecter dump_active .. 0 homeless 2021-02-06T22:54:05.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.498+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f0004d60 con 0x7f3718098360 2021-02-06T22:54:05.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.501+0000 7f3714ff9700 10 client.4479.objecter ms_handle_connect 0x7f36f80308a0 2021-02-06T22:54:05.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.502+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f37040123c0 con 0x7f3718098360 2021-02-06T22:54:05.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.748+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f36f00059b0 con 0x7f3718098360 2021-02-06T22:54:05.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.749+0000 7f3714ff9700 1 -- 172.21.15.51:0/1338326188 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f37040123c0 con 0x7f3718098360 2021-02-06T22:54:05.749 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:05.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 10 librados: watch_flush enter 2021-02-06T22:54:05.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 10 librados: watch_flush exit 2021-02-06T22:54:05.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 20 client.4479.objecter shutdown clearing up homeless session... 2021-02-06T22:54:05.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 10 client.4479.objecter successfully canceled tick 2021-02-06T22:54:05.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.106:6812/33219 conn(0x7f36f80308a0 legacy=0x7f36f8032d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 >> v1:172.21.15.51:6789/0 conn(0x7f3718098360 legacy=0x7f37181337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:05.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 shutdown_connections 2021-02-06T22:54:05.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 >> 172.21.15.51:0/1338326188 conn(0x7f371809b5e0 msgr2=0x7f37181255e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:05.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 shutdown_connections 2021-02-06T22:54:05.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 -- 172.21.15.51:0/1338326188 wait complete. 2021-02-06T22:54:05.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:05.750+0000 7f371eb24700 1 librados: shutdown 2021-02-06T22:54:05.761 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:08.763 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:08.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.898+0000 7f08ae5c3700 1 Processor -- start 2021-02-06T22:54:08.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.898+0000 7f08ae5c3700 1 -- start start 2021-02-06T22:54:08.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08ae5c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8095440 con 0x7f08a812ce00 2021-02-06T22:54:08.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08ae5c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a80907b0 con 0x7f08a8092bf0 2021-02-06T22:54:08.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08ae5c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8091010 con 0x7f08a808fa70 2021-02-06T22:54:08.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08a7fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f08a808fa70 0x7f08a80921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60356/0 (socket says 172.21.15.51:60356) 2021-02-06T22:54:08.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08acb60700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 0x7f08a812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60018/0 (socket says 172.21.15.51:60018) 2021-02-06T22:54:08.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.899+0000 7f08a7fff700 1 -- 172.21.15.51:0/1372120584 learned_addr learned my addr 172.21.15.51:0/1372120584 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:08.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08acb60700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 legacy=0x7f08a812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a7fff700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.51:6790/0 conn(0x7f08a808fa70 legacy=0x7f08a80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967179127 0 0) 0x7f08a8095440 con 0x7f08a812ce00 2021-02-06T22:54:08.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0894003230 con 0x7f08a812ce00 2021-02-06T22:54:08.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569954977 0 0) 0x7f08a8091010 con 0x7f08a808fa70 2021-02-06T22:54:08.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a8095440 con 0x7f08a808fa70 2021-02-06T22:54:08.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a77fe700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.106:6789/0 conn(0x7f08a8092bf0 legacy=0x7f08a80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2396676486 0 0) 0x7f08a8095440 con 0x7f08a808fa70 2021-02-06T22:54:08.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.106:6789/0 conn(0x7f08a8092bf0 legacy=0x7f08a80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:08.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 legacy=0x7f08a812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:08.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a80912b0 con 0x7f08a808fa70 2021-02-06T22:54:08.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f089c001930 con 0x7f08a808fa70 2021-02-06T22:54:08.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f089c001c50 con 0x7f08a808fa70 2021-02-06T22:54:08.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08a6ffd700 1 -- 172.21.15.51:0/1372120584 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f089c005860 con 0x7f08a808fa70 2021-02-06T22:54:08.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08ae5c3700 1 -- 172.21.15.51:0/1372120584 >> v1:172.21.15.51:6790/0 conn(0x7f08a808fa70 legacy=0x7f08a80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:08.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08ae5c3700 1 -- 172.21.15.51:0/1372120584 shutdown_connections 2021-02-06T22:54:08.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.901+0000 7f08ae5c3700 1 -- 172.21.15.51:0/1372120584 >> 172.21.15.51:0/1372120584 conn(0x7f08a8096860 msgr2=0x7f08a8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:08.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.902+0000 7f08ae5c3700 1 -- 172.21.15.51:0/1372120584 shutdown_connections 2021-02-06T22:54:08.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.902+0000 7f08ae5c3700 1 -- 172.21.15.51:0/1372120584 wait complete. 2021-02-06T22:54:08.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.902+0000 7f08ae5c3700 1 librados: starting msgr at 2021-02-06T22:54:08.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.902+0000 7f08ae5c3700 1 librados: starting objecter 2021-02-06T22:54:08.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.902+0000 7f08ae5c3700 1 Processor -- start 2021-02-06T22:54:08.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 -- start start 2021-02-06T22:54:08.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 librados: setting wanted keys 2021-02-06T22:54:08.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 librados: calling monclient init 2021-02-06T22:54:08.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8128c10 con 0x7f08a812ce00 2021-02-06T22:54:08.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a8128eb0 con 0x7f08a808fa70 2021-02-06T22:54:08.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08ae5c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08a813a070 con 0x7f08a8092bf0 2021-02-06T22:54:08.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08a77fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f08a8092bf0 0x7f08a812c380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60364/0 (socket says 172.21.15.51:60364) 2021-02-06T22:54:08.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.903+0000 7f08a77fe700 1 -- 172.21.15.51:0/3071170526 learned_addr learned my addr 172.21.15.51:0/3071170526 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:08.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.906+0000 7f08acb60700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 legacy=0x7f08a8141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08a77fe700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.51:6790/0 conn(0x7f08a8092bf0 legacy=0x7f08a812c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter ms_handle_connect 0x7f08a812ce00 2021-02-06T22:54:08.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:08.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter ms_handle_connect 0x7f08a8092bf0 2021-02-06T22:54:08.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:08.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter ms_handle_connect 0x7f08a808fa70 2021-02-06T22:54:08.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08acb60700 1 --1- 172.21.15.51:0/3071170526 >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 0x7f08a8141cb0 :-1 s=OPENED pgs=177 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f08a8128c10 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:54:08.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:08.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08a7fff700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.106:6789/0 conn(0x7f08a808fa70 legacy=0x7f08a8139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:08.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732678315 0 0) 0x7f08a813a070 con 0x7f08a8092bf0 2021-02-06T22:54:08.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0888004bd0 con 0x7f08a8092bf0 2021-02-06T22:54:08.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1597346601 0 0) 0x7f0888004bd0 con 0x7f08a8092bf0 2021-02-06T22:54:08.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f08a813a070 con 0x7f08a8092bf0 2021-02-06T22:54:08.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0898001b90 con 0x7f08a8092bf0 2021-02-06T22:54:08.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637417198 0 0) 0x7f08a8128eb0 con 0x7f08a808fa70 2021-02-06T22:54:08.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0888004bd0 con 0x7f08a808fa70 2021-02-06T22:54:08.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 855162348 0 0) 0x7f08a813a070 con 0x7f08a8092bf0 2021-02-06T22:54:08.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.106:6789/0 conn(0x7f08a808fa70 legacy=0x7f08a8139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:08.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.51:6789/0 conn(0x7f08a812ce00 legacy=0x7f08a8141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:08.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a813a720 con 0x7f08a8092bf0 2021-02-06T22:54:08.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379633066 0 0) 0x7f08a8128c10 con 0x7f08a812ce00 2021-02-06T22:54:08.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a812ca90 con 0x7f08a8092bf0 2021-02-06T22:54:08.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08ae5c3700 10 client.4472.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:08.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a8066f90 con 0x7f08a8092bf0 2021-02-06T22:54:08.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08ae5c3700 1 librados: init done 2021-02-06T22:54:08.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0898002270 con 0x7f08a8092bf0 2021-02-06T22:54:08.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0898002580 con 0x7f08a8092bf0 2021-02-06T22:54:08.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0898002760 con 0x7f08a8092bf0 2021-02-06T22:54:08.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0898039480 con 0x7f08a8092bf0 2021-02-06T22:54:08.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 10 client.4472.objecter ms_dispatch 0x7f08a8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:08.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 3 client.4472.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:08.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 3 client.4472.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:08.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f088ffff700 20 client.4472.objecter dump_active .. 0 homeless 2021-02-06T22:54:08.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.907+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880004d60 con 0x7f08a8092bf0 2021-02-06T22:54:08.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.910+0000 7f088ffff700 10 client.4472.objecter ms_handle_connect 0x7f08880304e0 2021-02-06T22:54:08.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:08.912+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0898002cd0 con 0x7f08a8092bf0 2021-02-06T22:54:09.159 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.158+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f08800059b0 con 0x7f08a8092bf0 2021-02-06T22:54:09.159 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.159+0000 7f088ffff700 1 -- 172.21.15.51:0/3071170526 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0898012370 con 0x7f08a8092bf0 2021-02-06T22:54:09.159 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:09.161 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 10 librados: watch_flush enter 2021-02-06T22:54:09.161 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 10 librados: watch_flush exit 2021-02-06T22:54:09.161 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 20 client.4472.objecter shutdown clearing up homeless session... 2021-02-06T22:54:09.162 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 10 client.4472.objecter successfully canceled tick 2021-02-06T22:54:09.162 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.106:6812/33219 conn(0x7f08880304e0 legacy=0x7f08880329a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:09.162 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 >> v1:172.21.15.51:6790/0 conn(0x7f08a8092bf0 legacy=0x7f08a812c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:09.163 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 shutdown_connections 2021-02-06T22:54:09.163 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 >> 172.21.15.51:0/3071170526 conn(0x7f08a8096860 msgr2=0x7f08a8093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:09.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 shutdown_connections 2021-02-06T22:54:09.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 -- 172.21.15.51:0/3071170526 wait complete. 2021-02-06T22:54:09.164 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:09.160+0000 7f08ae5c3700 1 librados: shutdown 2021-02-06T22:54:09.171 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:12.173 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:12.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.309+0000 7fde3b809700 1 Processor -- start 2021-02-06T22:54:12.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.309+0000 7fde3b809700 1 -- start start 2021-02-06T22:54:12.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.309+0000 7fde3b809700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340915d0 con 0x7fde340629e0 2021-02-06T22:54:12.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.309+0000 7fde3b809700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34091ac0 con 0x7fde340928d0 2021-02-06T22:54:12.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.309+0000 7fde3b809700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34091d60 con 0x7fde340999a0 2021-02-06T22:54:12.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.310+0000 7fde38da4700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fde340629e0 0x7fde34090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60026/0 (socket says 172.21.15.51:60026) 2021-02-06T22:54:12.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.310+0000 7fde395a5700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fde340999a0 0x7fde340907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60368/0 (socket says 172.21.15.51:60368) 2021-02-06T22:54:12.312 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.310+0000 7fde38da4700 1 -- 172.21.15.51:0/3220294498 learned_addr learned my addr 172.21.15.51:0/3220294498 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:12.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde395a5700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.51:6790/0 conn(0x7fde340999a0 legacy=0x7fde340907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde38da4700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.51:6789/0 conn(0x7fde340629e0 legacy=0x7fde34090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde39da6700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.106:6789/0 conn(0x7fde340928d0 legacy=0x7fde3412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026805993 0 0) 0x7fde34091d60 con 0x7fde340999a0 2021-02-06T22:54:12.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde1c003230 con 0x7fde340999a0 2021-02-06T22:54:12.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632197443 0 0) 0x7fde340915d0 con 0x7fde340629e0 2021-02-06T22:54:12.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde34091d60 con 0x7fde340629e0 2021-02-06T22:54:12.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13827693 0 0) 0x7fde34091ac0 con 0x7fde340928d0 2021-02-06T22:54:12.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde340915d0 con 0x7fde340928d0 2021-02-06T22:54:12.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3983682340 0 0) 0x7fde1c003230 con 0x7fde340999a0 2021-02-06T22:54:12.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.106:6789/0 conn(0x7fde340928d0 legacy=0x7fde3412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.51:6789/0 conn(0x7fde340629e0 legacy=0x7fde34090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.326 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34092000 con 0x7fde340999a0 2021-02-06T22:54:12.326 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde30001930 con 0x7fde340999a0 2021-02-06T22:54:12.326 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde30001c40 con 0x7fde340999a0 2021-02-06T22:54:12.326 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.312+0000 7fde23fff700 1 -- 172.21.15.51:0/3220294498 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde30004690 con 0x7fde340999a0 2021-02-06T22:54:12.327 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.313+0000 7fde3b809700 1 -- 172.21.15.51:0/3220294498 >> v1:172.21.15.51:6790/0 conn(0x7fde340999a0 legacy=0x7fde340907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.327 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.313+0000 7fde3b809700 1 -- 172.21.15.51:0/3220294498 shutdown_connections 2021-02-06T22:54:12.327 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.313+0000 7fde3b809700 1 -- 172.21.15.51:0/3220294498 >> 172.21.15.51:0/3220294498 conn(0x7fde34096860 msgr2=0x7fde34099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:12.327 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.313+0000 7fde3b809700 1 -- 172.21.15.51:0/3220294498 shutdown_connections 2021-02-06T22:54:12.327 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.313+0000 7fde3b809700 1 -- 172.21.15.51:0/3220294498 wait complete. 2021-02-06T22:54:12.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 librados: starting msgr at 2021-02-06T22:54:12.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 librados: starting objecter 2021-02-06T22:54:12.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 Processor -- start 2021-02-06T22:54:12.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 -- start start 2021-02-06T22:54:12.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 librados: setting wanted keys 2021-02-06T22:54:12.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 librados: calling monclient init 2021-02-06T22:54:12.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34117b00 con 0x7fde340999a0 2021-02-06T22:54:12.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34117da0 con 0x7fde340629e0 2021-02-06T22:54:12.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.314+0000 7fde3b809700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde34115ca0 con 0x7fde340928d0 2021-02-06T22:54:12.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.315+0000 7fde38da4700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fde340928d0 0x7fde3413b9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60376/0 (socket says 172.21.15.51:60376) 2021-02-06T22:54:12.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.315+0000 7fde38da4700 1 -- 172.21.15.51:0/982187768 learned_addr learned my addr 172.21.15.51:0/982187768 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:12.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde39da6700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.51:6789/0 conn(0x7fde340999a0 legacy=0x7fde3413f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde38da4700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.51:6790/0 conn(0x7fde340928d0 legacy=0x7fde3413b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter ms_handle_connect 0x7fde340999a0 2021-02-06T22:54:12.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:12.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter ms_handle_connect 0x7fde340928d0 2021-02-06T22:54:12.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:12.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde395a5700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.106:6789/0 conn(0x7fde340629e0 legacy=0x7fde34133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:12.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143369604 0 0) 0x7fde34117b00 con 0x7fde340999a0 2021-02-06T22:54:12.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde14004bd0 con 0x7fde340999a0 2021-02-06T22:54:12.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter ms_handle_connect 0x7fde340629e0 2021-02-06T22:54:12.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:12.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351969161 0 0) 0x7fde34115ca0 con 0x7fde340928d0 2021-02-06T22:54:12.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde34117b00 con 0x7fde340928d0 2021-02-06T22:54:12.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203465734 0 0) 0x7fde34117da0 con 0x7fde340629e0 2021-02-06T22:54:12.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde34115ca0 con 0x7fde340629e0 2021-02-06T22:54:12.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2818231893 0 0) 0x7fde14004bd0 con 0x7fde340999a0 2021-02-06T22:54:12.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde34117da0 con 0x7fde340999a0 2021-02-06T22:54:12.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde2c001f60 con 0x7fde340999a0 2021-02-06T22:54:12.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 451421000 0 0) 0x7fde34117b00 con 0x7fde340928d0 2021-02-06T22:54:12.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde14004bd0 con 0x7fde340928d0 2021-02-06T22:54:12.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde24001c20 con 0x7fde340928d0 2021-02-06T22:54:12.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 761454269 0 0) 0x7fde34115ca0 con 0x7fde340629e0 2021-02-06T22:54:12.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde34117b00 con 0x7fde340629e0 2021-02-06T22:54:12.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde300018f0 con 0x7fde340629e0 2021-02-06T22:54:12.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 270507033 0 0) 0x7fde34117da0 con 0x7fde340999a0 2021-02-06T22:54:12.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.51:6790/0 conn(0x7fde340928d0 legacy=0x7fde3413b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.106:6789/0 conn(0x7fde340629e0 legacy=0x7fde34133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34134220 con 0x7fde340999a0 2021-02-06T22:54:12.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.317+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde341168d0 con 0x7fde340999a0 2021-02-06T22:54:12.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde3b809700 10 client.4491.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:12.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fde341308e0 con 0x7fde340999a0 2021-02-06T22:54:12.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde3b809700 1 librados: init done 2021-02-06T22:54:12.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde2c0025b0 con 0x7fde340999a0 2021-02-06T22:54:12.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde2c0020c0 con 0x7fde340999a0 2021-02-06T22:54:12.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fde2c002900 con 0x7fde340999a0 2021-02-06T22:54:12.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fde2c039790 con 0x7fde340999a0 2021-02-06T22:54:12.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 10 client.4491.objecter ms_dispatch 0x7fde34001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:12.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 3 client.4491.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:12.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 3 client.4491.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:12.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c004d60 con 0x7fde340999a0 2021-02-06T22:54:12.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.318+0000 7fde217fa700 20 client.4491.objecter dump_active .. 0 homeless 2021-02-06T22:54:12.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.321+0000 7fde217fa700 10 client.4491.objecter ms_handle_connect 0x7fde14030750 2021-02-06T22:54:12.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.323+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fde2c012620 con 0x7fde340999a0 2021-02-06T22:54:12.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.568+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde0c0059b0 con 0x7fde340999a0 2021-02-06T22:54:12.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.568+0000 7fde217fa700 1 -- 172.21.15.51:0/982187768 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fde2c012210 con 0x7fde340999a0 2021-02-06T22:54:12.568 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:12.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 10 librados: watch_flush enter 2021-02-06T22:54:12.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 10 librados: watch_flush exit 2021-02-06T22:54:12.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 20 client.4491.objecter shutdown clearing up homeless session... 2021-02-06T22:54:12.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 10 client.4491.objecter successfully canceled tick 2021-02-06T22:54:12.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.106:6812/33219 conn(0x7fde14030750 legacy=0x7fde14032c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 >> v1:172.21.15.51:6789/0 conn(0x7fde340999a0 legacy=0x7fde3413f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:12.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 shutdown_connections 2021-02-06T22:54:12.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 >> 172.21.15.51:0/982187768 conn(0x7fde34096860 msgr2=0x7fde340658f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:12.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 shutdown_connections 2021-02-06T22:54:12.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 -- 172.21.15.51:0/982187768 wait complete. 2021-02-06T22:54:12.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:12.570+0000 7fde3b809700 1 librados: shutdown 2021-02-06T22:54:12.580 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:15.581 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:15.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.717+0000 7fdf1e16f700 1 Processor -- start 2021-02-06T22:54:15.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.717+0000 7fdf1e16f700 1 -- start start 2021-02-06T22:54:15.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf1e16f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf18095050 con 0x7fdf18067a30 2021-02-06T22:54:15.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf1e16f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf18128c00 con 0x7fdf180999a0 2021-02-06T22:54:15.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf1e16f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf18095280 con 0x7fdf18067ec0 2021-02-06T22:54:15.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf17fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fdf18067ec0 0x7fdf18130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60384/0 (socket says 172.21.15.51:60384) 2021-02-06T22:54:15.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf17fff700 1 -- 172.21.15.51:0/2401796394 learned_addr learned my addr 172.21.15.51:0/2401796394 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:15.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.718+0000 7fdf16ffd700 1 --1- 172.21.15.51:0/2401796394 >> v1:172.21.15.51:6789/0 conn(0x7fdf18067a30 0x7fdf1812d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60042/0 (socket says 172.21.15.51:60042) 2021-02-06T22:54:15.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.720+0000 7fdf17fff700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.51:6790/0 conn(0x7fdf18067ec0 legacy=0x7fdf18130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.720+0000 7fdf16ffd700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.51:6789/0 conn(0x7fdf18067a30 legacy=0x7fdf1812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.720+0000 7fdf177fe700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.106:6789/0 conn(0x7fdf180999a0 legacy=0x7fdf181284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.721 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.720+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767431321 0 0) 0x7fdf18095050 con 0x7fdf18067a30 2021-02-06T22:54:15.721 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.720+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf04003230 con 0x7fdf18067a30 2021-02-06T22:54:15.721 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 131878303 0 0) 0x7fdf04003230 con 0x7fdf18067a30 2021-02-06T22:54:15.721 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.51:6790/0 conn(0x7fdf18067ec0 legacy=0x7fdf18130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.721 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.106:6789/0 conn(0x7fdf180999a0 legacy=0x7fdf181284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.722 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18095520 con 0x7fdf18067a30 2021-02-06T22:54:15.722 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fdf0c001930 con 0x7fdf18067a30 2021-02-06T22:54:15.722 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdf0c001c40 con 0x7fdf18067a30 2021-02-06T22:54:15.722 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf167fc700 1 -- 172.21.15.51:0/2401796394 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fdf0c004690 con 0x7fdf18067a30 2021-02-06T22:54:15.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf1e16f700 1 -- 172.21.15.51:0/2401796394 >> v1:172.21.15.51:6789/0 conn(0x7fdf18067a30 legacy=0x7fdf1812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf1e16f700 1 -- 172.21.15.51:0/2401796394 shutdown_connections 2021-02-06T22:54:15.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf1e16f700 1 -- 172.21.15.51:0/2401796394 >> 172.21.15.51:0/2401796394 conn(0x7fdf18096860 msgr2=0x7fdf18099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:15.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf1e16f700 1 -- 172.21.15.51:0/2401796394 shutdown_connections 2021-02-06T22:54:15.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.721+0000 7fdf1e16f700 1 -- 172.21.15.51:0/2401796394 wait complete. 2021-02-06T22:54:15.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 librados: starting msgr at 2021-02-06T22:54:15.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 librados: starting objecter 2021-02-06T22:54:15.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 Processor -- start 2021-02-06T22:54:15.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 -- start start 2021-02-06T22:54:15.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 librados: setting wanted keys 2021-02-06T22:54:15.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.722+0000 7fdf1e16f700 1 librados: calling monclient init 2021-02-06T22:54:15.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.723+0000 7fdf1e16f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180909e0 con 0x7fdf180999a0 2021-02-06T22:54:15.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.723+0000 7fdf1e16f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf18093230 con 0x7fdf18067ec0 2021-02-06T22:54:15.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.723+0000 7fdf1e16f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180927d0 con 0x7fdf18067a30 2021-02-06T22:54:15.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.723+0000 7fdf177fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fdf18067a30 0x7fdf180920c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60388/0 (socket says 172.21.15.51:60388) 2021-02-06T22:54:15.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.723+0000 7fdf177fe700 1 -- 172.21.15.51:0/3439424924 learned_addr learned my addr 172.21.15.51:0/3439424924 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:15.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdf177fe700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.51:6790/0 conn(0x7fdf18067a30 legacy=0x7fdf180920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter ms_handle_connect 0x7fdf18067a30 2021-02-06T22:54:15.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdf17fff700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.51:6789/0 conn(0x7fdf180999a0 legacy=0x7fdf181426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:15.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter ms_handle_connect 0x7fdf180999a0 2021-02-06T22:54:15.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:15.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdf16ffd700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.106:6789/0 conn(0x7fdf18067ec0 legacy=0x7fdf1813ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:15.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter ms_handle_connect 0x7fdf18067ec0 2021-02-06T22:54:15.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.725+0000 7fdeff7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:15.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249736215 0 0) 0x7fdf180909e0 con 0x7fdf180999a0 2021-02-06T22:54:15.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef8004bd0 con 0x7fdf180999a0 2021-02-06T22:54:15.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3636163051 0 0) 0x7fdef8004bd0 con 0x7fdf180999a0 2021-02-06T22:54:15.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf180909e0 con 0x7fdf180999a0 2021-02-06T22:54:15.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fdf10001ed0 con 0x7fdf180999a0 2021-02-06T22:54:15.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3524481366 0 0) 0x7fdf180909e0 con 0x7fdf180999a0 2021-02-06T22:54:15.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.51:6790/0 conn(0x7fdf18067a30 legacy=0x7fdf180920c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.106:6789/0 conn(0x7fdf18067ec0 legacy=0x7fdf1813ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf18090c10 con 0x7fdf180999a0 2021-02-06T22:54:15.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf180668c0 con 0x7fdf180999a0 2021-02-06T22:54:15.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdf1e16f700 10 client.4497.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:15.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf18136920 con 0x7fdf180999a0 2021-02-06T22:54:15.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdf1e16f700 1 librados: init done 2021-02-06T22:54:15.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fdf10004b20 con 0x7fdf180999a0 2021-02-06T22:54:15.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.726+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fdf10004e30 con 0x7fdf180999a0 2021-02-06T22:54:15.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fdf10004f90 con 0x7fdf180999a0 2021-02-06T22:54:15.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fdf100396d0 con 0x7fdf180999a0 2021-02-06T22:54:15.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 10 client.4497.objecter ms_dispatch 0x7fdf18001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:15.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 3 client.4497.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:15.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 3 client.4497.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:15.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdeff7fe700 20 client.4497.objecter dump_active .. 0 homeless 2021-02-06T22:54:15.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.727+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef0004d60 con 0x7fdf180999a0 2021-02-06T22:54:15.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.730+0000 7fdeff7fe700 10 client.4497.objecter ms_handle_connect 0x7fdef8030540 2021-02-06T22:54:15.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.731+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fdf100056a0 con 0x7fdf180999a0 2021-02-06T22:54:15.978 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.979+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdef00059b0 con 0x7fdf180999a0 2021-02-06T22:54:15.978 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.979+0000 7fdeff7fe700 1 -- 172.21.15.51:0/3439424924 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fdf10012150 con 0x7fdf180999a0 2021-02-06T22:54:15.979 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:15.980 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.980+0000 7fdf1e16f700 10 librados: watch_flush enter 2021-02-06T22:54:15.980 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.980+0000 7fdf1e16f700 10 librados: watch_flush exit 2021-02-06T22:54:15.981 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.980+0000 7fdf1e16f700 20 client.4497.objecter shutdown clearing up homeless session... 2021-02-06T22:54:15.981 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.980+0000 7fdf1e16f700 10 client.4497.objecter successfully canceled tick 2021-02-06T22:54:15.981 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.106:6812/33219 conn(0x7fdef8030540 legacy=0x7fdef8032a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.981 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 >> v1:172.21.15.51:6789/0 conn(0x7fdf180999a0 legacy=0x7fdf181426c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:15.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 shutdown_connections 2021-02-06T22:54:15.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 >> 172.21.15.51:0/3439424924 conn(0x7fdf18096860 msgr2=0x7fdf18121f30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:15.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 shutdown_connections 2021-02-06T22:54:15.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 -- 172.21.15.51:0/3439424924 wait complete. 2021-02-06T22:54:15.983 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:15.981+0000 7fdf1e16f700 1 librados: shutdown 2021-02-06T22:54:15.991 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:18.992 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:19.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.128+0000 7fcd97485700 1 Processor -- start 2021-02-06T22:54:19.128 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd97485700 1 -- start start 2021-02-06T22:54:19.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd97485700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd90095440 con 0x7fcd90092bf0 2021-02-06T22:54:19.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd97485700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd900907b0 con 0x7fcd9012ce00 2021-02-06T22:54:19.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd97485700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd90091010 con 0x7fcd9008fa70 2021-02-06T22:54:19.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd95221700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 0x7fcd900921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60396/0 (socket says 172.21.15.51:60396) 2021-02-06T22:54:19.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd95221700 1 -- 172.21.15.51:0/1726794875 learned_addr learned my addr 172.21.15.51:0/1726794875 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:19.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.129+0000 7fcd94a20700 1 --1- 172.21.15.51:0/1726794875 >> v1:172.21.15.51:6789/0 conn(0x7fcd90092bf0 0x7fcd900930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60054/0 (socket says 172.21.15.51:60054) 2021-02-06T22:54:19.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.131+0000 7fcd95221700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 legacy=0x7fcd900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.131+0000 7fcd94a20700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.51:6789/0 conn(0x7fcd90092bf0 legacy=0x7fcd900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd95a22700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.106:6789/0 conn(0x7fcd9012ce00 legacy=0x7fcd9012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837111913 0 0) 0x7fcd90091010 con 0x7fcd9008fa70 2021-02-06T22:54:19.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd78003230 con 0x7fcd9008fa70 2021-02-06T22:54:19.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177542125 0 0) 0x7fcd90095440 con 0x7fcd90092bf0 2021-02-06T22:54:19.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd90091010 con 0x7fcd90092bf0 2021-02-06T22:54:19.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 650755187 0 0) 0x7fcd78003230 con 0x7fcd9008fa70 2021-02-06T22:54:19.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.106:6789/0 conn(0x7fcd9012ce00 legacy=0x7fcd9012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.51:6789/0 conn(0x7fcd90092bf0 legacy=0x7fcd900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd900912b0 con 0x7fcd9008fa70 2021-02-06T22:54:19.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcd8c0019f0 con 0x7fcd9008fa70 2021-02-06T22:54:19.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd8c001d10 con 0x7fcd9008fa70 2021-02-06T22:54:19.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.132+0000 7fcd7ffff700 1 -- 172.21.15.51:0/1726794875 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcd8c004750 con 0x7fcd9008fa70 2021-02-06T22:54:19.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 -- 172.21.15.51:0/1726794875 >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 legacy=0x7fcd900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 -- 172.21.15.51:0/1726794875 shutdown_connections 2021-02-06T22:54:19.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 -- 172.21.15.51:0/1726794875 >> 172.21.15.51:0/1726794875 conn(0x7fcd90096860 msgr2=0x7fcd90099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:19.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 -- 172.21.15.51:0/1726794875 shutdown_connections 2021-02-06T22:54:19.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 -- 172.21.15.51:0/1726794875 wait complete. 2021-02-06T22:54:19.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 librados: starting msgr at 2021-02-06T22:54:19.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.133+0000 7fcd97485700 1 librados: starting objecter 2021-02-06T22:54:19.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 Processor -- start 2021-02-06T22:54:19.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 -- start start 2021-02-06T22:54:19.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 librados: setting wanted keys 2021-02-06T22:54:19.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 librados: calling monclient init 2021-02-06T22:54:19.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd90113e00 con 0x7fcd9012ce00 2021-02-06T22:54:19.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd901140a0 con 0x7fcd90092bf0 2021-02-06T22:54:19.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd97485700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd90114340 con 0x7fcd9008fa70 2021-02-06T22:54:19.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd95221700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 0x7fcd90139eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60400/0 (socket says 172.21.15.51:60400) 2021-02-06T22:54:19.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.134+0000 7fcd95221700 1 -- 172.21.15.51:0/715227824 learned_addr learned my addr 172.21.15.51:0/715227824 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:19.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.136+0000 7fcd95221700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 legacy=0x7fcd90139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.136+0000 7fcd7d7fa700 10 client.?.objecter ms_handle_connect 0x7fcd9008fa70 2021-02-06T22:54:19.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.136+0000 7fcd95a22700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.51:6789/0 conn(0x7fcd9012ce00 legacy=0x7fcd90142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.136+0000 7fcd7d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:19.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 10 client.?.objecter ms_handle_connect 0x7fcd9012ce00 2021-02-06T22:54:19.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:19.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878302424 0 0) 0x7fcd90114340 con 0x7fcd9008fa70 2021-02-06T22:54:19.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd70004bd0 con 0x7fcd9008fa70 2021-02-06T22:54:19.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435624717 0 0) 0x7fcd90113e00 con 0x7fcd9012ce00 2021-02-06T22:54:19.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd90114340 con 0x7fcd9012ce00 2021-02-06T22:54:19.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 10 client.?.objecter ms_handle_connect 0x7fcd90092bf0 2021-02-06T22:54:19.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:19.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd94a20700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.106:6789/0 conn(0x7fcd90092bf0 legacy=0x7fcd9013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:19.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2029351233 0 0) 0x7fcd70004bd0 con 0x7fcd9008fa70 2021-02-06T22:54:19.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd90113e00 con 0x7fcd9008fa70 2021-02-06T22:54:19.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcd8c004690 con 0x7fcd9008fa70 2021-02-06T22:54:19.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 337680522 0 0) 0x7fcd90114340 con 0x7fcd9012ce00 2021-02-06T22:54:19.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd70004bd0 con 0x7fcd9012ce00 2021-02-06T22:54:19.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcd88001ee0 con 0x7fcd9012ce00 2021-02-06T22:54:19.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981429374 0 0) 0x7fcd901140a0 con 0x7fcd90092bf0 2021-02-06T22:54:19.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd90114340 con 0x7fcd90092bf0 2021-02-06T22:54:19.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3292175522 0 0) 0x7fcd90113e00 con 0x7fcd9008fa70 2021-02-06T22:54:19.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.106:6789/0 conn(0x7fcd90092bf0 legacy=0x7fcd9013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.51:6789/0 conn(0x7fcd9012ce00 legacy=0x7fcd90142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd901316a0 con 0x7fcd9008fa70 2021-02-06T22:54:19.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90132340 con 0x7fcd9008fa70 2021-02-06T22:54:19.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd97485700 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:19.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9013a800 con 0x7fcd9008fa70 2021-02-06T22:54:19.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd97485700 1 librados: init done 2021-02-06T22:54:19.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcd8c0015d0 con 0x7fcd9008fa70 2021-02-06T22:54:19.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.137+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcd8c004ed0 con 0x7fcd9008fa70 2021-02-06T22:54:19.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fcd8c00d6d0 con 0x7fcd9008fa70 2021-02-06T22:54:19.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fcd8c0396f0 con 0x7fcd9008fa70 2021-02-06T22:54:19.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 10 client.4484.objecter ms_dispatch 0x7fcd90001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:19.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 3 client.4484.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:19.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 3 client.4484.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:19.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd7d7fa700 20 client.4484.objecter dump_active .. 0 homeless 2021-02-06T22:54:19.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.138+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd68004d60 con 0x7fcd9008fa70 2021-02-06T22:54:19.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.141+0000 7fcd7d7fa700 10 client.4484.objecter ms_handle_connect 0x7fcd70030720 2021-02-06T22:54:19.152 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.142+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fcd8c0126a0 con 0x7fcd9008fa70 2021-02-06T22:54:19.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.393+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcd680059b0 con 0x7fcd9008fa70 2021-02-06T22:54:19.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.394+0000 7fcd7d7fa700 1 -- 172.21.15.51:0/715227824 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fcd8c012290 con 0x7fcd9008fa70 2021-02-06T22:54:19.394 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:19.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 10 librados: watch_flush enter 2021-02-06T22:54:19.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 10 librados: watch_flush exit 2021-02-06T22:54:19.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 20 client.4484.objecter shutdown clearing up homeless session... 2021-02-06T22:54:19.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 10 client.4484.objecter successfully canceled tick 2021-02-06T22:54:19.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.106:6812/33219 conn(0x7fcd70030720 legacy=0x7fcd70032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 >> v1:172.21.15.51:6790/0 conn(0x7fcd9008fa70 legacy=0x7fcd90139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:19.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 shutdown_connections 2021-02-06T22:54:19.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 >> 172.21.15.51:0/715227824 conn(0x7fcd90096860 msgr2=0x7fcd90093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:19.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.395+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 shutdown_connections 2021-02-06T22:54:19.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.396+0000 7fcd97485700 1 -- 172.21.15.51:0/715227824 wait complete. 2021-02-06T22:54:19.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:19.396+0000 7fcd97485700 1 librados: shutdown 2021-02-06T22:54:19.406 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:22.407 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:22.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.543+0000 7f0ba32f3700 1 Processor -- start 2021-02-06T22:54:22.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba32f3700 1 -- start start 2021-02-06T22:54:22.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba32f3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c095440 con 0x7f0b9c092bf0 2021-02-06T22:54:22.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba32f3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0907b0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba32f3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c091010 con 0x7f0b9c08fa70 2021-02-06T22:54:22.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba088e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 0x7f0b9c0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60068/0 (socket says 172.21.15.51:60068) 2021-02-06T22:54:22.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba108f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0b9c08fa70 0x7f0b9c0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60410/0 (socket says 172.21.15.51:60410) 2021-02-06T22:54:22.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.544+0000 7f0ba088e700 1 -- 172.21.15.51:0/2321543102 learned_addr learned my addr 172.21.15.51:0/2321543102 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:22.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0ba108f700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.51:6790/0 conn(0x7f0b9c08fa70 legacy=0x7f0b9c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0ba088e700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 legacy=0x7f0b9c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647304244 0 0) 0x7f0b9c095440 con 0x7f0b9c092bf0 2021-02-06T22:54:22.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b84003230 con 0x7f0b9c092bf0 2021-02-06T22:54:22.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064192255 0 0) 0x7f0b9c091010 con 0x7f0b9c08fa70 2021-02-06T22:54:22.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c095440 con 0x7f0b9c08fa70 2021-02-06T22:54:22.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0ba1890700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.106:6789/0 conn(0x7f0b9c12ce00 legacy=0x7f0b9c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2370222882 0 0) 0x7f0b84003230 con 0x7f0b9c092bf0 2021-02-06T22:54:22.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.51:6790/0 conn(0x7f0b9c08fa70 legacy=0x7f0b9c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.106:6789/0 conn(0x7f0b9c12ce00 legacy=0x7f0b9c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0912b0 con 0x7f0b9c092bf0 2021-02-06T22:54:22.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0b8c001930 con 0x7f0b9c092bf0 2021-02-06T22:54:22.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0b8c001c40 con 0x7f0b9c092bf0 2021-02-06T22:54:22.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.547+0000 7f0b8bfff700 1 -- 172.21.15.51:0/2321543102 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0b8c004750 con 0x7f0b9c092bf0 2021-02-06T22:54:22.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2321543102 >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 legacy=0x7f0b9c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2321543102 shutdown_connections 2021-02-06T22:54:22.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2321543102 >> 172.21.15.51:0/2321543102 conn(0x7f0b9c096860 msgr2=0x7f0b9c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:22.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2321543102 shutdown_connections 2021-02-06T22:54:22.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2321543102 wait complete. 2021-02-06T22:54:22.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 librados: starting msgr at 2021-02-06T22:54:22.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.548+0000 7f0ba32f3700 1 librados: starting objecter 2021-02-06T22:54:22.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 Processor -- start 2021-02-06T22:54:22.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 -- start start 2021-02-06T22:54:22.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 librados: setting wanted keys 2021-02-06T22:54:22.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 librados: calling monclient init 2021-02-06T22:54:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c132090 con 0x7f0b9c092bf0 2021-02-06T22:54:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c110560 con 0x7f0b9c08fa70 2021-02-06T22:54:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba32f3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c090bf0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba088e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 0x7f0b9c13ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60076/0 (socket says 172.21.15.51:60076) 2021-02-06T22:54:22.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.549+0000 7f0ba088e700 1 -- 172.21.15.51:0/2715940493 learned_addr learned my addr 172.21.15.51:0/2715940493 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:22.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.551+0000 7f0ba1890700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.51:6790/0 conn(0x7f0b9c12ce00 legacy=0x7f0b9c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba088e700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 legacy=0x7f0b9c13ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter ms_handle_connect 0x7f0b9c12ce00 2021-02-06T22:54:22.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter ms_handle_connect 0x7f0b9c092bf0 2021-02-06T22:54:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167609933 0 0) 0x7f0b9c090bf0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c004bd0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862757049 0 0) 0x7f0b9c132090 con 0x7f0b9c092bf0 2021-02-06T22:54:22.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c090bf0 con 0x7f0b9c092bf0 2021-02-06T22:54:22.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter ms_handle_connect 0x7f0b9c08fa70 2021-02-06T22:54:22.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba108f700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.106:6789/0 conn(0x7f0b9c08fa70 legacy=0x7f0b9c139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1076956441 0 0) 0x7f0b7c004bd0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b9c132090 con 0x7f0b9c12ce00 2021-02-06T22:54:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0b94001e40 con 0x7f0b9c12ce00 2021-02-06T22:54:22.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3410713301 0 0) 0x7f0b9c090bf0 con 0x7f0b9c092bf0 2021-02-06T22:54:22.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b7c004bd0 con 0x7f0b9c092bf0 2021-02-06T22:54:22.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0b8c0018f0 con 0x7f0b9c092bf0 2021-02-06T22:54:22.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199674979 0 0) 0x7f0b9c110560 con 0x7f0b9c08fa70 2021-02-06T22:54:22.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c090bf0 con 0x7f0b9c08fa70 2021-02-06T22:54:22.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 336348764 0 0) 0x7f0b9c132090 con 0x7f0b9c12ce00 2021-02-06T22:54:22.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.106:6789/0 conn(0x7f0b9c08fa70 legacy=0x7f0b9c139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.51:6789/0 conn(0x7f0b9c092bf0 legacy=0x7f0b9c13ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c10fa30 con 0x7f0b9c12ce00 2021-02-06T22:54:22.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c131870 con 0x7f0b9c12ce00 2021-02-06T22:54:22.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba32f3700 10 client.4490.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:22.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c12c3e0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0ba32f3700 1 librados: init done 2021-02-06T22:54:22.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0b94002010 con 0x7f0b9c12ce00 2021-02-06T22:54:22.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.552+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0b94002710 con 0x7f0b9c12ce00 2021-02-06T22:54:22.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0b940028f0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0b940395e0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 10 client.4490.objecter ms_dispatch 0x7f0b9c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:22.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 3 client.4490.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:22.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 3 client.4490.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:22.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b74004d60 con 0x7f0b9c12ce00 2021-02-06T22:54:22.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.553+0000 7f0b897fa700 20 client.4490.objecter dump_active .. 0 homeless 2021-02-06T22:54:22.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.556+0000 7f0b897fa700 10 client.4490.objecter ms_handle_connect 0x7f0b7c030700 2021-02-06T22:54:22.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.557+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0b94003050 con 0x7f0b9c12ce00 2021-02-06T22:54:22.807 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.808+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0b740059b0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.808 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.808+0000 7f0b897fa700 1 -- 172.21.15.51:0/2715940493 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0b940120c0 con 0x7f0b9c12ce00 2021-02-06T22:54:22.808 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:22.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.809+0000 7f0ba32f3700 10 librados: watch_flush enter 2021-02-06T22:54:22.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.809+0000 7f0ba32f3700 10 librados: watch_flush exit 2021-02-06T22:54:22.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.809+0000 7f0ba32f3700 20 client.4490.objecter shutdown clearing up homeless session... 2021-02-06T22:54:22.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.809+0000 7f0ba32f3700 10 client.4490.objecter successfully canceled tick 2021-02-06T22:54:22.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.106:6812/33219 conn(0x7f0b7c030700 legacy=0x7f0b7c032bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 >> v1:172.21.15.51:6790/0 conn(0x7f0b9c12ce00 legacy=0x7f0b9c142470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:22.811 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 shutdown_connections 2021-02-06T22:54:22.811 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 >> 172.21.15.51:0/2715940493 conn(0x7f0b9c096860 msgr2=0x7f0b9c093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:22.811 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 shutdown_connections 2021-02-06T22:54:22.811 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 -- 172.21.15.51:0/2715940493 wait complete. 2021-02-06T22:54:22.812 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:22.810+0000 7f0ba32f3700 1 librados: shutdown 2021-02-06T22:54:22.820 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:25.821 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:25.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbeefa700 1 Processor -- start 2021-02-06T22:54:25.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbeefa700 1 -- start start 2021-02-06T22:54:25.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbeefa700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb8095440 con 0x7f5fb812ce00 2021-02-06T22:54:25.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbeefa700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb80907b0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbeefa700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb8091010 con 0x7f5fb808fa70 2021-02-06T22:54:25.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbcc96700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5fb808fa70 0x7f5fb80921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60426/0 (socket says 172.21.15.51:60426) 2021-02-06T22:54:25.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.957+0000 7f5fbd497700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 0x7f5fb812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60088/0 (socket says 172.21.15.51:60088) 2021-02-06T22:54:25.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.958+0000 7f5fbcc96700 1 -- 172.21.15.51:0/3449380192 learned_addr learned my addr 172.21.15.51:0/3449380192 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:25.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fbcc96700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.51:6790/0 conn(0x7f5fb808fa70 legacy=0x7f5fb80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fbd497700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241708168 0 0) 0x7f5fb8091010 con 0x7f5fb808fa70 2021-02-06T22:54:25.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f9c003230 con 0x7f5fb808fa70 2021-02-06T22:54:25.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843016484 0 0) 0x7f5fb8095440 con 0x7f5fb812ce00 2021-02-06T22:54:25.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb8091010 con 0x7f5fb812ce00 2021-02-06T22:54:25.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb7fff700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.106:6789/0 conn(0x7f5fb8092bf0 legacy=0x7f5fb80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 602178345 0 0) 0x7f5fb8091010 con 0x7f5fb812ce00 2021-02-06T22:54:25.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.51:6790/0 conn(0x7f5fb808fa70 legacy=0x7f5fb80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:25.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.106:6789/0 conn(0x7f5fb8092bf0 legacy=0x7f5fb80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:25.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb80912b0 con 0x7f5fb812ce00 2021-02-06T22:54:25.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5fb0001d70 con 0x7f5fb812ce00 2021-02-06T22:54:25.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5fb0001fd0 con 0x7f5fb812ce00 2021-02-06T22:54:25.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.960+0000 7f5fb77fe700 1 -- 172.21.15.51:0/3449380192 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5fb0004a10 con 0x7f5fb812ce00 2021-02-06T22:54:25.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.961+0000 7f5fbeefa700 1 -- 172.21.15.51:0/3449380192 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:25.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.961+0000 7f5fbeefa700 1 -- 172.21.15.51:0/3449380192 shutdown_connections 2021-02-06T22:54:25.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.961+0000 7f5fbeefa700 1 -- 172.21.15.51:0/3449380192 >> 172.21.15.51:0/3449380192 conn(0x7f5fb8096860 msgr2=0x7f5fb8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:25.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.961+0000 7f5fbeefa700 1 -- 172.21.15.51:0/3449380192 shutdown_connections 2021-02-06T22:54:25.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.961+0000 7f5fbeefa700 1 -- 172.21.15.51:0/3449380192 wait complete. 2021-02-06T22:54:25.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 librados: starting msgr at 2021-02-06T22:54:25.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 librados: starting objecter 2021-02-06T22:54:25.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 Processor -- start 2021-02-06T22:54:25.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 -- start start 2021-02-06T22:54:25.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 librados: setting wanted keys 2021-02-06T22:54:25.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 librados: calling monclient init 2021-02-06T22:54:25.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb8067250 con 0x7f5fb812ce00 2021-02-06T22:54:25.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb80674f0 con 0x7f5fb808fa70 2021-02-06T22:54:25.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.962+0000 7f5fbeefa700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb8067790 con 0x7f5fb8092bf0 2021-02-06T22:54:25.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.963+0000 7f5fb7fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5fb8092bf0 0x7f5fb812be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60434/0 (socket says 172.21.15.51:60434) 2021-02-06T22:54:25.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.963+0000 7f5fb7fff700 1 -- 172.21.15.51:0/557573556 learned_addr learned my addr 172.21.15.51:0/557573556 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:25.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb7fff700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6790/0 conn(0x7f5fb8092bf0 legacy=0x7f5fb812be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter ms_handle_connect 0x7f5fb8092bf0 2021-02-06T22:54:25.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:25.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter ms_handle_connect 0x7f5fb812ce00 2021-02-06T22:54:25.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:25.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbd497700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbd497700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2021-02-06T22:54:25.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbd497700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:54:25.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbd497700 1 --1- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 0x7f5fb813d760 :-1 s=OPENED pgs=189 cs=1 l=1).handle_message read tag failed 2021-02-06T22:54:25.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbd497700 1 --1- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 0x7f5fb813d760 :-1 s=OPENED pgs=189 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:54:25.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter ms_handle_connect 0x7f5fb808fa70 2021-02-06T22:54:25.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:25.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbcc96700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.106:6789/0 conn(0x7f5fb808fa70 legacy=0x7f5fb8135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:25.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583717249 0 0) 0x7f5fb8067790 con 0x7f5fb8092bf0 2021-02-06T22:54:25.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f98004bd0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639661660 0 0) 0x7f5fb80674f0 con 0x7f5fb808fa70 2021-02-06T22:54:25.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb8067790 con 0x7f5fb808fa70 2021-02-06T22:54:25.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1011310944 0 0) 0x7f5f98004bd0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5fb80674f0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5fa4001c20 con 0x7f5fb8092bf0 2021-02-06T22:54:25.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3212751761 0 0) 0x7f5fb80674f0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.106:6789/0 conn(0x7f5fb808fa70 legacy=0x7f5fb8135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:25.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6789/0 conn(0x7f5fb812ce00 legacy=0x7f5fb813d760 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:54:25.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb8065620 con 0x7f5fb8092bf0 2021-02-06T22:54:25.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb8135b20 con 0x7f5fb8092bf0 2021-02-06T22:54:25.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbeefa700 10 client.4496.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:25.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb812c6d0 con 0x7f5fb8092bf0 2021-02-06T22:54:25.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fbeefa700 1 librados: init done 2021-02-06T22:54:25.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5fa4002310 con 0x7f5fb8092bf0 2021-02-06T22:54:25.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.965+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5fa4002620 con 0x7f5fb8092bf0 2021-02-06T22:54:25.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f5fa4002800 con 0x7f5fb8092bf0 2021-02-06T22:54:25.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f5fa4039550 con 0x7f5fb8092bf0 2021-02-06T22:54:25.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 10 client.4496.objecter ms_dispatch 0x7f5fb8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:25.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 3 client.4496.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:25.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 3 client.4496.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:25.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.966+0000 7f5fb4ff9700 20 client.4496.objecter dump_active .. 0 homeless 2021-02-06T22:54:25.977 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.967+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f90004d60 con 0x7f5fb8092bf0 2021-02-06T22:54:25.978 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.969+0000 7f5fb4ff9700 10 client.4496.objecter ms_handle_connect 0x7f5f980303c0 2021-02-06T22:54:25.978 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:25.971+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f5fa4012440 con 0x7f5fb8092bf0 2021-02-06T22:54:26.220 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.220+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5f900059b0 con 0x7f5fb8092bf0 2021-02-06T22:54:26.220 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.221+0000 7f5fb4ff9700 1 -- 172.21.15.51:0/557573556 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f5fa4012210 con 0x7f5fb8092bf0 2021-02-06T22:54:26.220 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:26.222 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 10 librados: watch_flush enter 2021-02-06T22:54:26.222 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 10 librados: watch_flush exit 2021-02-06T22:54:26.222 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 20 client.4496.objecter shutdown clearing up homeless session... 2021-02-06T22:54:26.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 10 client.4496.objecter successfully canceled tick 2021-02-06T22:54:26.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.106:6812/33219 conn(0x7f5f980303c0 legacy=0x7f5f98032880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:26.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 >> v1:172.21.15.51:6790/0 conn(0x7f5fb8092bf0 legacy=0x7f5fb812be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:26.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.222+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 shutdown_connections 2021-02-06T22:54:26.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.223+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 >> 172.21.15.51:0/557573556 conn(0x7f5fb8096860 msgr2=0x7f5fb8122d20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:26.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.223+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 shutdown_connections 2021-02-06T22:54:26.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.223+0000 7f5fbeefa700 1 -- 172.21.15.51:0/557573556 wait complete. 2021-02-06T22:54:26.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:26.223+0000 7f5fbeefa700 1 librados: shutdown 2021-02-06T22:54:26.233 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:29.235 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:29.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.370+0000 7f28f5ab7700 1 Processor -- start 2021-02-06T22:54:29.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.370+0000 7f28f5ab7700 1 -- start start 2021-02-06T22:54:29.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.370+0000 7f28f5ab7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f0095440 con 0x7f28f0092bf0 2021-02-06T22:54:29.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.370+0000 7f28f5ab7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f00907b0 con 0x7f28f012ce00 2021-02-06T22:54:29.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.370+0000 7f28f5ab7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f0091010 con 0x7f28f008fa70 2021-02-06T22:54:29.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.371+0000 7f28eeffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f28f0092bf0 0x7f28f00930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60102/0 (socket says 172.21.15.51:60102) 2021-02-06T22:54:29.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.371+0000 7f28eeffd700 1 -- 172.21.15.51:0/303950911 learned_addr learned my addr 172.21.15.51:0/303950911 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:29.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.371+0000 7f28ef7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 0x7f28f00921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60444/0 (socket says 172.21.15.51:60444) 2021-02-06T22:54:29.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28eeffd700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.51:6789/0 conn(0x7f28f0092bf0 legacy=0x7f28f00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ef7fe700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 legacy=0x7f28f00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28effff700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913904830 0 0) 0x7f28f0095440 con 0x7f28f0092bf0 2021-02-06T22:54:29.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28dc003230 con 0x7f28f0092bf0 2021-02-06T22:54:29.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454978853 0 0) 0x7f28f0091010 con 0x7f28f008fa70 2021-02-06T22:54:29.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f0095440 con 0x7f28f008fa70 2021-02-06T22:54:29.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28effff700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2021-02-06T22:54:29.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28effff700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:54:29.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28effff700 1 --1- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 0x7f28f012f1f0 :-1 s=OPENED pgs=179 cs=1 l=1).handle_message read tag failed 2021-02-06T22:54:29.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28effff700 1 --1- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 0x7f28f012f1f0 :-1 s=OPENED pgs=179 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:54:29.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 988024038 0 0) 0x7f28dc003230 con 0x7f28f0092bf0 2021-02-06T22:54:29.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 legacy=0x7f28f00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.106:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f012f1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:54:29.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00912b0 con 0x7f28f0092bf0 2021-02-06T22:54:29.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.373+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f28e4001930 con 0x7f28f0092bf0 2021-02-06T22:54:29.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f28e4001c40 con 0x7f28f0092bf0 2021-02-06T22:54:29.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28ee7fc700 1 -- 172.21.15.51:0/303950911 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f28e4004750 con 0x7f28f0092bf0 2021-02-06T22:54:29.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28f5ab7700 1 -- 172.21.15.51:0/303950911 >> v1:172.21.15.51:6789/0 conn(0x7f28f0092bf0 legacy=0x7f28f00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28f5ab7700 1 -- 172.21.15.51:0/303950911 shutdown_connections 2021-02-06T22:54:29.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28f5ab7700 1 -- 172.21.15.51:0/303950911 >> 172.21.15.51:0/303950911 conn(0x7f28f0096860 msgr2=0x7f28f0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:29.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28f5ab7700 1 -- 172.21.15.51:0/303950911 shutdown_connections 2021-02-06T22:54:29.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.374+0000 7f28f5ab7700 1 -- 172.21.15.51:0/303950911 wait complete. 2021-02-06T22:54:29.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 librados: starting msgr at 2021-02-06T22:54:29.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 librados: starting objecter 2021-02-06T22:54:29.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 Processor -- start 2021-02-06T22:54:29.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 -- start start 2021-02-06T22:54:29.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 librados: setting wanted keys 2021-02-06T22:54:29.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.375+0000 7f28f5ab7700 1 librados: calling monclient init 2021-02-06T22:54:29.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.376+0000 7f28f5ab7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f01364c0 con 0x7f28f012ce00 2021-02-06T22:54:29.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.376+0000 7f28f5ab7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f010fdd0 con 0x7f28f0092bf0 2021-02-06T22:54:29.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.376+0000 7f28f5ab7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f0090bf0 con 0x7f28f008fa70 2021-02-06T22:54:29.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.376+0000 7f28ef7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 0x7f28f01356a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60450/0 (socket says 172.21.15.51:60450) 2021-02-06T22:54:29.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.376+0000 7f28ef7fe700 1 -- 172.21.15.51:0/2655166033 learned_addr learned my addr 172.21.15.51:0/2655166033 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:29.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28ef7fe700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 legacy=0x7f28f01356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28effff700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.51:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f013d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter ms_handle_connect 0x7f28f008fa70 2021-02-06T22:54:29.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:29.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter ms_handle_connect 0x7f28f012ce00 2021-02-06T22:54:29.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:29.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030218315 0 0) 0x7f28f0090bf0 con 0x7f28f008fa70 2021-02-06T22:54:29.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28eeffd700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.106:6789/0 conn(0x7f28f0092bf0 legacy=0x7f28f0135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:29.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0004bd0 con 0x7f28f008fa70 2021-02-06T22:54:29.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter ms_handle_connect 0x7f28f0092bf0 2021-02-06T22:54:29.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:29.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407465429 0 0) 0x7f28f01364c0 con 0x7f28f012ce00 2021-02-06T22:54:29.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f0090bf0 con 0x7f28f012ce00 2021-02-06T22:54:29.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035500705 0 0) 0x7f28f010fdd0 con 0x7f28f0092bf0 2021-02-06T22:54:29.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28f01364c0 con 0x7f28f0092bf0 2021-02-06T22:54:29.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4239279210 0 0) 0x7f28d0004bd0 con 0x7f28f008fa70 2021-02-06T22:54:29.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28f010fdd0 con 0x7f28f008fa70 2021-02-06T22:54:29.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f28e8001ef0 con 0x7f28f008fa70 2021-02-06T22:54:29.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3445057779 0 0) 0x7f28f0090bf0 con 0x7f28f012ce00 2021-02-06T22:54:29.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28d0004bd0 con 0x7f28f012ce00 2021-02-06T22:54:29.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f28e0001c70 con 0x7f28f012ce00 2021-02-06T22:54:29.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2460930157 0 0) 0x7f28f010fdd0 con 0x7f28f008fa70 2021-02-06T22:54:29.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.378+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.106:6789/0 conn(0x7f28f0092bf0 legacy=0x7f28f0135db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.51:6789/0 conn(0x7f28f012ce00 legacy=0x7f28f013d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f0065980 con 0x7f28f008fa70 2021-02-06T22:54:29.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f0066620 con 0x7f28f008fa70 2021-02-06T22:54:29.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28f5ab7700 10 client.4502.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:29.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f01263a0 con 0x7f28f008fa70 2021-02-06T22:54:29.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28f5ab7700 1 librados: init done 2021-02-06T22:54:29.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f28e8004be0 con 0x7f28f008fa70 2021-02-06T22:54:29.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f28e8004ef0 con 0x7f28f008fa70 2021-02-06T22:54:29.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f28e80050d0 con 0x7f28f008fa70 2021-02-06T22:54:29.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.379+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c8004d60 con 0x7f28f008fa70 2021-02-06T22:54:29.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.380+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f28e80397b0 con 0x7f28f008fa70 2021-02-06T22:54:29.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.380+0000 7f28d77fe700 10 client.4502.objecter ms_dispatch 0x7f28f0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:29.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.380+0000 7f28d77fe700 3 client.4502.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:29.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.380+0000 7f28d77fe700 3 client.4502.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:29.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.380+0000 7f28d77fe700 20 client.4502.objecter dump_active .. 0 homeless 2021-02-06T22:54:29.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.382+0000 7f28d77fe700 10 client.4502.objecter ms_handle_connect 0x7f28d0030740 2021-02-06T22:54:29.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.383+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f28e80126a0 con 0x7f28f008fa70 2021-02-06T22:54:29.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.634+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f28c80059b0 con 0x7f28f008fa70 2021-02-06T22:54:29.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.634+0000 7f28d77fe700 1 -- 172.21.15.51:0/2655166033 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f28e8012290 con 0x7f28f008fa70 2021-02-06T22:54:29.634 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:29.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 10 librados: watch_flush enter 2021-02-06T22:54:29.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 10 librados: watch_flush exit 2021-02-06T22:54:29.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 20 client.4502.objecter shutdown clearing up homeless session... 2021-02-06T22:54:29.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 10 client.4502.objecter successfully canceled tick 2021-02-06T22:54:29.637 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.106:6812/33219 conn(0x7f28d0030740 legacy=0x7f28d0032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.637 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 >> v1:172.21.15.51:6790/0 conn(0x7f28f008fa70 legacy=0x7f28f01356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:29.637 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 shutdown_connections 2021-02-06T22:54:29.637 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 >> 172.21.15.51:0/2655166033 conn(0x7f28f0096860 msgr2=0x7f28f00991d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:29.637 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 shutdown_connections 2021-02-06T22:54:29.638 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 -- 172.21.15.51:0/2655166033 wait complete. 2021-02-06T22:54:29.638 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:29.636+0000 7f28f5ab7700 1 librados: shutdown 2021-02-06T22:54:29.646 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:32.648 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:32.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.783+0000 7fe69b470700 1 Processor -- start 2021-02-06T22:54:32.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe69b470700 1 -- start start 2021-02-06T22:54:32.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe69b470700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe694093ce0 con 0x7fe694066910 2021-02-06T22:54:32.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe69b470700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69412ab50 con 0x7fe694066d70 2021-02-06T22:54:32.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe69b470700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe694095f80 con 0x7fe69412afd0 2021-02-06T22:54:32.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe698a0b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe694066910 0x7fe69412f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60122/0 (socket says 172.21.15.51:60122) 2021-02-06T22:54:32.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe69920c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe69412afd0 0x7fe69412a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60460/0 (socket says 172.21.15.51:60460) 2021-02-06T22:54:32.785 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.784+0000 7fe698a0b700 1 -- 172.21.15.51:0/900931120 learned_addr learned my addr 172.21.15.51:0/900931120 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:32.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe698a0b700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.51:6789/0 conn(0x7fe694066910 legacy=0x7fe69412f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe69920c700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.51:6790/0 conn(0x7fe69412afd0 legacy=0x7fe69412a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543271326 0 0) 0x7fe694093ce0 con 0x7fe694066910 2021-02-06T22:54:32.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe67c003230 con 0x7fe694066910 2021-02-06T22:54:32.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992466624 0 0) 0x7fe694095f80 con 0x7fe69412afd0 2021-02-06T22:54:32.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe694093ce0 con 0x7fe69412afd0 2021-02-06T22:54:32.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe699a0d700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.106:6789/0 conn(0x7fe694066d70 legacy=0x7fe694132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 98650716 0 0) 0x7fe67c003230 con 0x7fe694066910 2021-02-06T22:54:32.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.51:6790/0 conn(0x7fe69412afd0 legacy=0x7fe69412a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:32.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.106:6789/0 conn(0x7fe694066d70 legacy=0x7fe694132f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:32.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6940631a0 con 0x7fe694066910 2021-02-06T22:54:32.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe684001930 con 0x7fe694066910 2021-02-06T22:54:32.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe684001c40 con 0x7fe694066910 2021-02-06T22:54:32.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.787+0000 7fe683fff700 1 -- 172.21.15.51:0/900931120 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe684004750 con 0x7fe694066910 2021-02-06T22:54:32.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 -- 172.21.15.51:0/900931120 >> v1:172.21.15.51:6789/0 conn(0x7fe694066910 legacy=0x7fe69412f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:32.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 -- 172.21.15.51:0/900931120 shutdown_connections 2021-02-06T22:54:32.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 -- 172.21.15.51:0/900931120 >> 172.21.15.51:0/900931120 conn(0x7fe6940997e0 msgr2=0x7fe694099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:32.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 -- 172.21.15.51:0/900931120 shutdown_connections 2021-02-06T22:54:32.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 -- 172.21.15.51:0/900931120 wait complete. 2021-02-06T22:54:32.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 librados: starting msgr at 2021-02-06T22:54:32.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.788+0000 7fe69b470700 1 librados: starting objecter 2021-02-06T22:54:32.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 Processor -- start 2021-02-06T22:54:32.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 -- start start 2021-02-06T22:54:32.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 librados: setting wanted keys 2021-02-06T22:54:32.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 librados: calling monclient init 2021-02-06T22:54:32.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69412c060 con 0x7fe694066910 2021-02-06T22:54:32.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe694133eb0 con 0x7fe69412afd0 2021-02-06T22:54:32.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe69b470700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69412c290 con 0x7fe694066d70 2021-02-06T22:54:32.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe698a0b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe694066d70 0x7fe6941337a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60468/0 (socket says 172.21.15.51:60468) 2021-02-06T22:54:32.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.789+0000 7fe698a0b700 1 -- 172.21.15.51:0/1485890110 learned_addr learned my addr 172.21.15.51:0/1485890110 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:32.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe698a0b700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.51:6790/0 conn(0x7fe694066d70 legacy=0x7fe6941337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe69920c700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.51:6789/0 conn(0x7fe694066910 legacy=0x7fe6941346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter ms_handle_connect 0x7fe694066d70 2021-02-06T22:54:32.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:32.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter ms_handle_connect 0x7fe694066910 2021-02-06T22:54:32.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:32.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter ms_handle_connect 0x7fe69412afd0 2021-02-06T22:54:32.799 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:32.799 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe699a0d700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.106:6789/0 conn(0x7fe69412afd0 legacy=0x7fe694141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:32.799 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978752782 0 0) 0x7fe69412c290 con 0x7fe694066d70 2021-02-06T22:54:32.799 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe674004bd0 con 0x7fe694066d70 2021-02-06T22:54:32.799 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560861378 0 0) 0x7fe69412c060 con 0x7fe694066910 2021-02-06T22:54:32.800 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe69412c290 con 0x7fe694066910 2021-02-06T22:54:32.800 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706193794 0 0) 0x7fe694133eb0 con 0x7fe69412afd0 2021-02-06T22:54:32.800 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe69412c060 con 0x7fe69412afd0 2021-02-06T22:54:32.800 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2420261959 0 0) 0x7fe674004bd0 con 0x7fe694066d70 2021-02-06T22:54:32.800 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe694133eb0 con 0x7fe694066d70 2021-02-06T22:54:32.801 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe6840018f0 con 0x7fe694066d70 2021-02-06T22:54:32.801 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1232269524 0 0) 0x7fe69412c290 con 0x7fe694066910 2021-02-06T22:54:32.801 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe674004bd0 con 0x7fe694066910 2021-02-06T22:54:32.801 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe690001540 con 0x7fe694066910 2021-02-06T22:54:32.801 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3822285367 0 0) 0x7fe69412c060 con 0x7fe69412afd0 2021-02-06T22:54:32.802 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe69412c290 con 0x7fe69412afd0 2021-02-06T22:54:32.802 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe68c001eb0 con 0x7fe69412afd0 2021-02-06T22:54:32.802 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3560625349 0 0) 0x7fe694133eb0 con 0x7fe694066d70 2021-02-06T22:54:32.802 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.106:6789/0 conn(0x7fe69412afd0 legacy=0x7fe694141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:32.803 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.51:6789/0 conn(0x7fe694066910 legacy=0x7fe6941346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:32.803 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe694095460 con 0x7fe694066d70 2021-02-06T22:54:32.803 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe694125e20 con 0x7fe694066d70 2021-02-06T22:54:32.803 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe69b470700 10 client.4508.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:32.803 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe694137140 con 0x7fe694066d70 2021-02-06T22:54:32.804 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe69b470700 1 librados: init done 2021-02-06T22:54:32.804 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe684004d80 con 0x7fe694066d70 2021-02-06T22:54:32.804 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.792+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe684005090 con 0x7fe694066d70 2021-02-06T22:54:32.804 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fe68400d850 con 0x7fe694066d70 2021-02-06T22:54:32.804 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fe684039690 con 0x7fe694066d70 2021-02-06T22:54:32.805 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 10 client.4508.objecter ms_dispatch 0x7fe694001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:32.805 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 3 client.4508.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:32.805 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 3 client.4508.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:32.805 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe6817fa700 20 client.4508.objecter dump_active .. 0 homeless 2021-02-06T22:54:32.805 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.793+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c004d60 con 0x7fe694066d70 2021-02-06T22:54:32.806 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.796+0000 7fe6817fa700 10 client.4508.objecter ms_handle_connect 0x7fe674030780 2021-02-06T22:54:32.806 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:32.798+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fe6840125e0 con 0x7fe694066d70 2021-02-06T22:54:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.045+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe66c0059b0 con 0x7fe694066d70 2021-02-06T22:54:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.046+0000 7fe6817fa700 1 -- 172.21.15.51:0/1485890110 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fe6840123b0 con 0x7fe694066d70 2021-02-06T22:54:33.046 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 10 librados: watch_flush enter 2021-02-06T22:54:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 10 librados: watch_flush exit 2021-02-06T22:54:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 20 client.4508.objecter shutdown clearing up homeless session... 2021-02-06T22:54:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 10 client.4508.objecter successfully canceled tick 2021-02-06T22:54:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.106:6812/33219 conn(0x7fe674030780 legacy=0x7fe674032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.047+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 >> v1:172.21.15.51:6790/0 conn(0x7fe694066d70 legacy=0x7fe6941337a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.048+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 shutdown_connections 2021-02-06T22:54:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.048+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 >> 172.21.15.51:0/1485890110 conn(0x7fe6940997e0 msgr2=0x7fe6941273d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.048+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 shutdown_connections 2021-02-06T22:54:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.048+0000 7fe69b470700 1 -- 172.21.15.51:0/1485890110 wait complete. 2021-02-06T22:54:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:33.048+0000 7fe69b470700 1 librados: shutdown 2021-02-06T22:54:33.058 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:36.059 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:36.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.194+0000 7f39a14d6700 1 Processor -- start 2021-02-06T22:54:36.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.194+0000 7f39a14d6700 1 -- start start 2021-02-06T22:54:36.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f39a14d6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0998a0 con 0x7f399c097200 2021-02-06T22:54:36.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f39a14d6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c099b10 con 0x7f399c093e80 2021-02-06T22:54:36.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f39a14d6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c099db0 con 0x7f399c0976b0 2021-02-06T22:54:36.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f399b7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f399c0976b0 0x7f399c1331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60476/0 (socket says 172.21.15.51:60476) 2021-02-06T22:54:36.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f399b7fe700 1 -- 172.21.15.51:0/2482545216 learned_addr learned my addr 172.21.15.51:0/2482545216 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:36.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.195+0000 7f399a7fc700 1 --1- 172.21.15.51:0/2482545216 >> v1:172.21.15.51:6789/0 conn(0x7f399c097200 0x7f399c12fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60136/0 (socket says 172.21.15.51:60136) 2021-02-06T22:54:36.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f399a7fc700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.51:6789/0 conn(0x7f399c097200 legacy=0x7f399c12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f399b7fe700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.51:6790/0 conn(0x7f399c0976b0 legacy=0x7f399c1331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f399affd700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.106:6789/0 conn(0x7f399c093e80 legacy=0x7f399c1278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844436626 0 0) 0x7f399c0998a0 con 0x7f399c097200 2021-02-06T22:54:36.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3988003230 con 0x7f399c097200 2021-02-06T22:54:36.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174498480 0 0) 0x7f399c099db0 con 0x7f399c0976b0 2021-02-06T22:54:36.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.197+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c0998a0 con 0x7f399c0976b0 2021-02-06T22:54:36.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935377825 0 0) 0x7f399c099b10 con 0x7f399c093e80 2021-02-06T22:54:36.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c099db0 con 0x7f399c093e80 2021-02-06T22:54:36.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 183238348 0 0) 0x7f3988003230 con 0x7f399c097200 2021-02-06T22:54:36.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.51:6790/0 conn(0x7f399c0976b0 legacy=0x7f399c1331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.106:6789/0 conn(0x7f399c093e80 legacy=0x7f399c1278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c127480 con 0x7f399c097200 2021-02-06T22:54:36.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3990001930 con 0x7f399c097200 2021-02-06T22:54:36.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3990001c40 con 0x7f399c097200 2021-02-06T22:54:36.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f3999ffb700 1 -- 172.21.15.51:0/2482545216 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3990004690 con 0x7f399c097200 2021-02-06T22:54:36.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f39a14d6700 1 -- 172.21.15.51:0/2482545216 >> v1:172.21.15.51:6789/0 conn(0x7f399c097200 legacy=0x7f399c12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f39a14d6700 1 -- 172.21.15.51:0/2482545216 shutdown_connections 2021-02-06T22:54:36.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f39a14d6700 1 -- 172.21.15.51:0/2482545216 >> 172.21.15.51:0/2482545216 conn(0x7f399c09ae00 msgr2=0x7f399c09d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:36.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f39a14d6700 1 -- 172.21.15.51:0/2482545216 shutdown_connections 2021-02-06T22:54:36.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.198+0000 7f39a14d6700 1 -- 172.21.15.51:0/2482545216 wait complete. 2021-02-06T22:54:36.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 librados: starting msgr at 2021-02-06T22:54:36.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 librados: starting objecter 2021-02-06T22:54:36.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 Processor -- start 2021-02-06T22:54:36.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 -- start start 2021-02-06T22:54:36.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 librados: setting wanted keys 2021-02-06T22:54:36.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.199+0000 7f39a14d6700 1 librados: calling monclient init 2021-02-06T22:54:36.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.200+0000 7f39a14d6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c12c080 con 0x7f399c093e80 2021-02-06T22:54:36.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.200+0000 7f39a14d6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c12c320 con 0x7f399c0976b0 2021-02-06T22:54:36.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.200+0000 7f39a14d6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c12c5c0 con 0x7f399c097200 2021-02-06T22:54:36.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.200+0000 7f399affd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f399c093e80 0x7f399c133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60138/0 (socket says 172.21.15.51:60138) 2021-02-06T22:54:36.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.200+0000 7f399affd700 1 -- 172.21.15.51:0/1143754931 learned_addr learned my addr 172.21.15.51:0/1143754931 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:36.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f399affd700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.51:6789/0 conn(0x7f399c093e80 legacy=0x7f399c133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f399a7fc700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.51:6790/0 conn(0x7f399c097200 legacy=0x7f399c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.220 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter ms_handle_connect 0x7f399c093e80 2021-02-06T22:54:36.220 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:36.221 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter ms_handle_connect 0x7f399c097200 2021-02-06T22:54:36.221 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:36.221 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924887268 0 0) 0x7f399c12c080 con 0x7f399c093e80 2021-02-06T22:54:36.222 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c004bd0 con 0x7f399c093e80 2021-02-06T22:54:36.222 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter ms_handle_connect 0x7f399c0976b0 2021-02-06T22:54:36.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f399b7fe700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.106:6789/0 conn(0x7f399c0976b0 legacy=0x7f399c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:36.223 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:36.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523089100 0 0) 0x7f399c12c5c0 con 0x7f399c097200 2021-02-06T22:54:36.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.202+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c12c080 con 0x7f399c097200 2021-02-06T22:54:36.224 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2815404166 0 0) 0x7f397c004bd0 con 0x7f399c093e80 2021-02-06T22:54:36.225 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f399c12c5c0 con 0x7f399c093e80 2021-02-06T22:54:36.225 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3547771614 0 0) 0x7f399c12c080 con 0x7f399c097200 2021-02-06T22:54:36.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f397c004bd0 con 0x7f399c097200 2021-02-06T22:54:36.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f398c001c40 con 0x7f399c093e80 2021-02-06T22:54:36.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39900018f0 con 0x7f399c097200 2021-02-06T22:54:36.226 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112625868 0 0) 0x7f399c12c320 con 0x7f399c0976b0 2021-02-06T22:54:36.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c12c080 con 0x7f399c0976b0 2021-02-06T22:54:36.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 16458057 0 0) 0x7f399c12c5c0 con 0x7f399c093e80 2021-02-06T22:54:36.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.51:6790/0 conn(0x7f399c097200 legacy=0x7f399c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.106:6789/0 conn(0x7f399c0976b0 legacy=0x7f399c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.227 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c12a450 con 0x7f399c093e80 2021-02-06T22:54:36.228 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c134f00 con 0x7f399c093e80 2021-02-06T22:54:36.228 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f39a14d6700 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:36.229 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c1343a0 con 0x7f399c093e80 2021-02-06T22:54:36.229 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f39a14d6700 1 librados: init done 2021-02-06T22:54:36.229 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f398c002430 con 0x7f399c093e80 2021-02-06T22:54:36.229 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.203+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f398c002740 con 0x7f399c093e80 2021-02-06T22:54:36.230 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f398c002920 con 0x7f399c093e80 2021-02-06T22:54:36.230 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f398c039560 con 0x7f399c093e80 2021-02-06T22:54:36.230 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 10 client.4533.objecter ms_dispatch 0x7f399c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:36.230 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 3 client.4533.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:36.231 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 3 client.4533.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:36.231 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3974004d60 con 0x7f399c093e80 2021-02-06T22:54:36.231 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.204+0000 7f3982ffd700 20 client.4533.objecter dump_active .. 0 homeless 2021-02-06T22:54:36.231 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.207+0000 7f3982ffd700 10 client.4533.objecter ms_handle_connect 0x7f397c030810 2021-02-06T22:54:36.231 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.208+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f398c012470 con 0x7f399c093e80 2021-02-06T22:54:36.455 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.455+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39740059b0 con 0x7f399c093e80 2021-02-06T22:54:36.456 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.455+0000 7f3982ffd700 1 -- 172.21.15.51:0/1143754931 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f398c012060 con 0x7f399c093e80 2021-02-06T22:54:36.456 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:36.457 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 10 librados: watch_flush enter 2021-02-06T22:54:36.457 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 10 librados: watch_flush exit 2021-02-06T22:54:36.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 20 client.4533.objecter shutdown clearing up homeless session... 2021-02-06T22:54:36.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 10 client.4533.objecter successfully canceled tick 2021-02-06T22:54:36.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.106:6812/33219 conn(0x7f397c030810 legacy=0x7f397c032cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 >> v1:172.21.15.51:6789/0 conn(0x7f399c093e80 legacy=0x7f399c133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:36.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 shutdown_connections 2021-02-06T22:54:36.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 >> 172.21.15.51:0/1143754931 conn(0x7f399c09ae00 msgr2=0x7f399c0951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:36.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 shutdown_connections 2021-02-06T22:54:36.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 -- 172.21.15.51:0/1143754931 wait complete. 2021-02-06T22:54:36.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:36.457+0000 7f39a14d6700 1 librados: shutdown 2021-02-06T22:54:36.468 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:39.469 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:39.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.603+0000 7f5897df9700 1 Processor -- start 2021-02-06T22:54:39.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.603+0000 7f5897df9700 1 -- start start 2021-02-06T22:54:39.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.603+0000 7f5897df9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5890095440 con 0x7f589008fa70 2021-02-06T22:54:39.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.603+0000 7f5897df9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900907b0 con 0x7f589012ce00 2021-02-06T22:54:39.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.603+0000 7f5897df9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5890091010 con 0x7f5890092bf0 2021-02-06T22:54:39.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.604+0000 7f5895394700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5890092bf0 0x7f58900930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60494/0 (socket says 172.21.15.51:60494) 2021-02-06T22:54:39.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.604+0000 7f5895b95700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f589008fa70 0x7f58900921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60150/0 (socket says 172.21.15.51:60150) 2021-02-06T22:54:39.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.604+0000 7f5895394700 1 -- 172.21.15.51:0/1548390185 learned_addr learned my addr 172.21.15.51:0/1548390185 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:39.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5895b95700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.51:6789/0 conn(0x7f589008fa70 legacy=0x7f58900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5895394700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.51:6790/0 conn(0x7f5890092bf0 legacy=0x7f58900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743583800 0 0) 0x7f5890091010 con 0x7f5890092bf0 2021-02-06T22:54:39.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5878003230 con 0x7f5890092bf0 2021-02-06T22:54:39.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390896276 0 0) 0x7f5890095440 con 0x7f589008fa70 2021-02-06T22:54:39.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5896396700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.106:6789/0 conn(0x7f589012ce00 legacy=0x7f589012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5890091010 con 0x7f589008fa70 2021-02-06T22:54:39.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1783632510 0 0) 0x7f5890091010 con 0x7f589008fa70 2021-02-06T22:54:39.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.51:6790/0 conn(0x7f5890092bf0 legacy=0x7f58900930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.106:6789/0 conn(0x7f589012ce00 legacy=0x7f589012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900912b0 con 0x7f589008fa70 2021-02-06T22:54:39.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f588c0018b0 con 0x7f589008fa70 2021-02-06T22:54:39.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f588c001bd0 con 0x7f589008fa70 2021-02-06T22:54:39.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.606+0000 7f5894b93700 1 -- 172.21.15.51:0/1548390185 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f588c004690 con 0x7f589008fa70 2021-02-06T22:54:39.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.607+0000 7f5897df9700 1 -- 172.21.15.51:0/1548390185 >> v1:172.21.15.51:6789/0 conn(0x7f589008fa70 legacy=0x7f58900921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.607+0000 7f5897df9700 1 -- 172.21.15.51:0/1548390185 shutdown_connections 2021-02-06T22:54:39.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.607+0000 7f5897df9700 1 -- 172.21.15.51:0/1548390185 >> 172.21.15.51:0/1548390185 conn(0x7f5890096860 msgr2=0x7f5890099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:39.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.607+0000 7f5897df9700 1 -- 172.21.15.51:0/1548390185 shutdown_connections 2021-02-06T22:54:39.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.607+0000 7f5897df9700 1 -- 172.21.15.51:0/1548390185 wait complete. 2021-02-06T22:54:39.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 librados: starting msgr at 2021-02-06T22:54:39.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 librados: starting objecter 2021-02-06T22:54:39.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 Processor -- start 2021-02-06T22:54:39.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 -- start start 2021-02-06T22:54:39.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 librados: setting wanted keys 2021-02-06T22:54:39.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 librados: calling monclient init 2021-02-06T22:54:39.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5890127280 con 0x7f5890092bf0 2021-02-06T22:54:39.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5890127520 con 0x7f589012ce00 2021-02-06T22:54:39.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5897df9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58901277c0 con 0x7f589008fa70 2021-02-06T22:54:39.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5895394700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f5890092bf0 0x7f5890120320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60158/0 (socket says 172.21.15.51:60158) 2021-02-06T22:54:39.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5895b95700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f589008fa70 0x7f589011fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60498/0 (socket says 172.21.15.51:60498) 2021-02-06T22:54:39.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.608+0000 7f5895394700 1 -- 172.21.15.51:0/1809309723 learned_addr learned my addr 172.21.15.51:0/1809309723 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:39.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f5895394700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.51:6789/0 conn(0x7f5890092bf0 legacy=0x7f5890120320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f587dffb700 10 client.?.objecter ms_handle_connect 0x7f5890092bf0 2021-02-06T22:54:39.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f587dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:39.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f5895b95700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.51:6790/0 conn(0x7f589008fa70 legacy=0x7f589011fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f587dffb700 10 client.?.objecter ms_handle_connect 0x7f589008fa70 2021-02-06T22:54:39.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.610+0000 7f587dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:39.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484807375 0 0) 0x7f5890127280 con 0x7f5890092bf0 2021-02-06T22:54:39.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5870004bd0 con 0x7f5890092bf0 2021-02-06T22:54:39.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443018445 0 0) 0x7f58901277c0 con 0x7f589008fa70 2021-02-06T22:54:39.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5890127280 con 0x7f589008fa70 2021-02-06T22:54:39.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 10 client.?.objecter ms_handle_connect 0x7f589012ce00 2021-02-06T22:54:39.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:39.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f5896396700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.106:6789/0 conn(0x7f589012ce00 legacy=0x7f5890124a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:39.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 334434172 0 0) 0x7f5890127280 con 0x7f589008fa70 2021-02-06T22:54:39.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58901277c0 con 0x7f589008fa70 2021-02-06T22:54:39.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f588c001870 con 0x7f589008fa70 2021-02-06T22:54:39.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2253395750 0 0) 0x7f5870004bd0 con 0x7f5890092bf0 2021-02-06T22:54:39.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5890127280 con 0x7f5890092bf0 2021-02-06T22:54:39.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5880001d30 con 0x7f5890092bf0 2021-02-06T22:54:39.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976100181 0 0) 0x7f5890127520 con 0x7f589012ce00 2021-02-06T22:54:39.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5870004bd0 con 0x7f589012ce00 2021-02-06T22:54:39.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 672503112 0 0) 0x7f58901277c0 con 0x7f589008fa70 2021-02-06T22:54:39.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.106:6789/0 conn(0x7f589012ce00 legacy=0x7f5890124a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.51:6789/0 conn(0x7f5890092bf0 legacy=0x7f5890120320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890128120 con 0x7f589008fa70 2021-02-06T22:54:39.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58901283d0 con 0x7f589008fa70 2021-02-06T22:54:39.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f588c004cc0 con 0x7f589008fa70 2021-02-06T22:54:39.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f588c005050 con 0x7f589008fa70 2021-02-06T22:54:39.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f5897df9700 10 client.4520.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:39.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5890142da0 con 0x7f589008fa70 2021-02-06T22:54:39.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.611+0000 7f5897df9700 1 librados: init done 2021-02-06T22:54:39.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f588c00d890 con 0x7f589008fa70 2021-02-06T22:54:39.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f588c0395a0 con 0x7f589008fa70 2021-02-06T22:54:39.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 10 client.4520.objecter ms_dispatch 0x7f5890001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:39.622 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 3 client.4520.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:39.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 3 client.4520.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:39.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58900581b0 con 0x7f589008fa70 2021-02-06T22:54:39.623 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.612+0000 7f587dffb700 20 client.4520.objecter dump_active .. 0 homeless 2021-02-06T22:54:39.624 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.615+0000 7f587dffb700 10 client.4520.objecter ms_handle_connect 0x7f5870030680 2021-02-06T22:54:39.624 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.616+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f588c012550 con 0x7f589008fa70 2021-02-06T22:54:39.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.867+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5890090b40 con 0x7f589008fa70 2021-02-06T22:54:39.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.868+0000 7f587dffb700 1 -- 172.21.15.51:0/1809309723 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f588c012140 con 0x7f589008fa70 2021-02-06T22:54:39.868 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:39.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 10 librados: watch_flush enter 2021-02-06T22:54:39.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 10 librados: watch_flush exit 2021-02-06T22:54:39.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 20 client.4520.objecter shutdown clearing up homeless session... 2021-02-06T22:54:39.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 10 client.4520.objecter successfully canceled tick 2021-02-06T22:54:39.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.106:6812/33219 conn(0x7f5870030680 legacy=0x7f5870032b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 >> v1:172.21.15.51:6790/0 conn(0x7f589008fa70 legacy=0x7f589011fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:39.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 shutdown_connections 2021-02-06T22:54:39.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 >> 172.21.15.51:0/1809309723 conn(0x7f5890096860 msgr2=0x7f5890122c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:39.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 shutdown_connections 2021-02-06T22:54:39.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 -- 172.21.15.51:0/1809309723 wait complete. 2021-02-06T22:54:39.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:39.869+0000 7f5897df9700 1 librados: shutdown 2021-02-06T22:54:39.880 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:42.882 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:43.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.018+0000 7fe2f97cb700 1 Processor -- start 2021-02-06T22:54:43.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.018+0000 7fe2f97cb700 1 -- start start 2021-02-06T22:54:43.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.018+0000 7fe2f97cb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f4095440 con 0x7fe2f408fa70 2021-02-06T22:54:43.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.018+0000 7fe2f97cb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40907b0 con 0x7fe2f4092bf0 2021-02-06T22:54:43.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.019+0000 7fe2f97cb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f4091010 con 0x7fe2f412ce00 2021-02-06T22:54:43.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.019+0000 7fe2f37fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe2f412ce00 0x7fe2f412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60508/0 (socket says 172.21.15.51:60508) 2021-02-06T22:54:43.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.019+0000 7fe2f2ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe2f408fa70 0x7fe2f40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60164/0 (socket says 172.21.15.51:60164) 2021-02-06T22:54:43.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.019+0000 7fe2f37fe700 1 -- 172.21.15.51:0/2904239604 learned_addr learned my addr 172.21.15.51:0/2904239604 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:43.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f37fe700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.51:6790/0 conn(0x7fe2f412ce00 legacy=0x7fe2f412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f2ffd700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.51:6789/0 conn(0x7fe2f408fa70 legacy=0x7fe2f40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538378398 0 0) 0x7fe2f4091010 con 0x7fe2f412ce00 2021-02-06T22:54:43.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003230 con 0x7fe2f412ce00 2021-02-06T22:54:43.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f27fc700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.106:6789/0 conn(0x7fe2f4092bf0 legacy=0x7fe2f40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899217759 0 0) 0x7fe2f4095440 con 0x7fe2f408fa70 2021-02-06T22:54:43.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f4091010 con 0x7fe2f408fa70 2021-02-06T22:54:43.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1431139327 0 0) 0x7fe2e0003230 con 0x7fe2f412ce00 2021-02-06T22:54:43.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.106:6789/0 conn(0x7fe2f4092bf0 legacy=0x7fe2f40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.51:6789/0 conn(0x7fe2f408fa70 legacy=0x7fe2f40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f40912b0 con 0x7fe2f412ce00 2021-02-06T22:54:43.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2ec001d70 con 0x7fe2f412ce00 2021-02-06T22:54:43.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe2ec002090 con 0x7fe2f412ce00 2021-02-06T22:54:43.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.021+0000 7fe2f1ffb700 1 -- 172.21.15.51:0/2904239604 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2ec004ad0 con 0x7fe2f412ce00 2021-02-06T22:54:43.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.022+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2904239604 >> v1:172.21.15.51:6790/0 conn(0x7fe2f412ce00 legacy=0x7fe2f412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.022+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2904239604 shutdown_connections 2021-02-06T22:54:43.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.022+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2904239604 >> 172.21.15.51:0/2904239604 conn(0x7fe2f4096860 msgr2=0x7fe2f4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:43.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.022+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2904239604 shutdown_connections 2021-02-06T22:54:43.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.022+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2904239604 wait complete. 2021-02-06T22:54:43.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 librados: starting msgr at 2021-02-06T22:54:43.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 librados: starting objecter 2021-02-06T22:54:43.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 Processor -- start 2021-02-06T22:54:43.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 -- start start 2021-02-06T22:54:43.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 librados: setting wanted keys 2021-02-06T22:54:43.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.023+0000 7fe2f97cb700 1 librados: calling monclient init 2021-02-06T22:54:43.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.024+0000 7fe2f97cb700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f4090bf0 con 0x7fe2f4092bf0 2021-02-06T22:54:43.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.024+0000 7fe2f97cb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f412ec80 con 0x7fe2f408fa70 2021-02-06T22:54:43.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.024+0000 7fe2f97cb700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f412ef20 con 0x7fe2f412ce00 2021-02-06T22:54:43.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.024+0000 7fe2f27fc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe2f4092bf0 0x7fe2f413e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60172/0 (socket says 172.21.15.51:60172) 2021-02-06T22:54:43.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.024+0000 7fe2f27fc700 1 -- 172.21.15.51:0/2350732259 learned_addr learned my addr 172.21.15.51:0/2350732259 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:43.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2f37fe700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.51:6790/0 conn(0x7fe2f412ce00 legacy=0x7fe2f4142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2f27fc700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.51:6789/0 conn(0x7fe2f4092bf0 legacy=0x7fe2f413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter ms_handle_connect 0x7fe2f412ce00 2021-02-06T22:54:43.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:43.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter ms_handle_connect 0x7fe2f4092bf0 2021-02-06T22:54:43.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:43.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter ms_handle_connect 0x7fe2f408fa70 2021-02-06T22:54:43.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2f2ffd700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.106:6789/0 conn(0x7fe2f408fa70 legacy=0x7fe2f4132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:43.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:43.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677969965 0 0) 0x7fe2f412ef20 con 0x7fe2f412ce00 2021-02-06T22:54:43.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2f27fc700 1 --1- 172.21.15.51:0/2350732259 >> v1:172.21.15.51:6789/0 conn(0x7fe2f4092bf0 0x7fe2f413e9d0 :-1 s=OPENED pgs=204 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fe2f4090bf0 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:54:43.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4004bd0 con 0x7fe2f412ce00 2021-02-06T22:54:43.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076925260 0 0) 0x7fe2f412ec80 con 0x7fe2f408fa70 2021-02-06T22:54:43.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f412ef20 con 0x7fe2f408fa70 2021-02-06T22:54:43.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 631253485 0 0) 0x7fe2d4004bd0 con 0x7fe2f412ce00 2021-02-06T22:54:43.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2f412ec80 con 0x7fe2f412ce00 2021-02-06T22:54:43.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2ec004a10 con 0x7fe2f412ce00 2021-02-06T22:54:43.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 548092343 0 0) 0x7fe2f412ef20 con 0x7fe2f408fa70 2021-02-06T22:54:43.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2d4004bd0 con 0x7fe2f408fa70 2021-02-06T22:54:43.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2e4001c70 con 0x7fe2f408fa70 2021-02-06T22:54:43.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2831665205 0 0) 0x7fe2f412ec80 con 0x7fe2f412ce00 2021-02-06T22:54:43.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.106:6789/0 conn(0x7fe2f408fa70 legacy=0x7fe2f4132850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.51:6789/0 conn(0x7fe2f4092bf0 legacy=0x7fe2f413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.036 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f412c820 con 0x7fe2f412ce00 2021-02-06T22:54:43.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557164427 0 0) 0x7fe2f4090bf0 con 0x7fe2f4092bf0 2021-02-06T22:54:43.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.026+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f412d890 con 0x7fe2f412ce00 2021-02-06T22:54:43.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2f97cb700 10 client.4526.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:43.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f4127720 con 0x7fe2f412ce00 2021-02-06T22:54:43.037 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2f97cb700 1 librados: init done 2021-02-06T22:54:43.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe2ec0018e0 con 0x7fe2f412ce00 2021-02-06T22:54:43.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe2ec005290 con 0x7fe2f412ce00 2021-02-06T22:54:43.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fe2ec00da50 con 0x7fe2f412ce00 2021-02-06T22:54:43.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc004d60 con 0x7fe2f412ce00 2021-02-06T22:54:43.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fe2ec0397d0 con 0x7fe2f412ce00 2021-02-06T22:54:43.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 10 client.4526.objecter ms_dispatch 0x7fe2f4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:43.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 3 client.4526.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:43.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.027+0000 7fe2daffd700 3 client.4526.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:43.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.028+0000 7fe2daffd700 20 client.4526.objecter dump_active .. 0 homeless 2021-02-06T22:54:43.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.030+0000 7fe2daffd700 10 client.4526.objecter ms_handle_connect 0x7fe2d4030510 2021-02-06T22:54:43.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.032+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fe2ec0127e0 con 0x7fe2f412ce00 2021-02-06T22:54:43.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.280+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe2cc0059b0 con 0x7fe2f412ce00 2021-02-06T22:54:43.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.280+0000 7fe2daffd700 1 -- 172.21.15.51:0/2350732259 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fe2ec0123d0 con 0x7fe2f412ce00 2021-02-06T22:54:43.280 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:43.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 10 librados: watch_flush enter 2021-02-06T22:54:43.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 10 librados: watch_flush exit 2021-02-06T22:54:43.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 20 client.4526.objecter shutdown clearing up homeless session... 2021-02-06T22:54:43.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 10 client.4526.objecter successfully canceled tick 2021-02-06T22:54:43.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.106:6812/33219 conn(0x7fe2d4030510 legacy=0x7fe2d40329d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 >> v1:172.21.15.51:6790/0 conn(0x7fe2f412ce00 legacy=0x7fe2f4142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:43.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 shutdown_connections 2021-02-06T22:54:43.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 >> 172.21.15.51:0/2350732259 conn(0x7fe2f4096860 msgr2=0x7fe2f4093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:43.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 shutdown_connections 2021-02-06T22:54:43.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 -- 172.21.15.51:0/2350732259 wait complete. 2021-02-06T22:54:43.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:43.282+0000 7fe2f97cb700 1 librados: shutdown 2021-02-06T22:54:43.292 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:46.293 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:46.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.429+0000 7fae3e710700 1 Processor -- start 2021-02-06T22:54:46.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.429+0000 7fae3e710700 1 -- start start 2021-02-06T22:54:46.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae3e710700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380998a0 con 0x7fae38093e80 2021-02-06T22:54:46.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae3e710700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae38099b10 con 0x7fae38097200 2021-02-06T22:54:46.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae3e710700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae38099db0 con 0x7fae380976b0 2021-02-06T22:54:46.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae37fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 0x7fae381278b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60180/0 (socket says 172.21.15.51:60180) 2021-02-06T22:54:46.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae3ccad700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fae380976b0 0x7fae381331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60526/0 (socket says 172.21.15.51:60526) 2021-02-06T22:54:46.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.430+0000 7fae37fff700 1 -- 172.21.15.51:0/167359178 learned_addr learned my addr 172.21.15.51:0/167359178 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:46.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae37fff700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 legacy=0x7fae381278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae3ccad700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.51:6790/0 conn(0x7fae380976b0 legacy=0x7fae381331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae377fe700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.106:6789/0 conn(0x7fae38097200 legacy=0x7fae3812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917462451 0 0) 0x7fae38099db0 con 0x7fae380976b0 2021-02-06T22:54:46.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae24003230 con 0x7fae380976b0 2021-02-06T22:54:46.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111215382 0 0) 0x7fae380998a0 con 0x7fae38093e80 2021-02-06T22:54:46.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae38099db0 con 0x7fae38093e80 2021-02-06T22:54:46.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670144339 0 0) 0x7fae38099b10 con 0x7fae38097200 2021-02-06T22:54:46.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae380998a0 con 0x7fae38097200 2021-02-06T22:54:46.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2459157172 0 0) 0x7fae24003230 con 0x7fae380976b0 2021-02-06T22:54:46.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.106:6789/0 conn(0x7fae38097200 legacy=0x7fae3812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 legacy=0x7fae381278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38127480 con 0x7fae380976b0 2021-02-06T22:54:46.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.432+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae30001c70 con 0x7fae380976b0 2021-02-06T22:54:46.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae30001f40 con 0x7fae380976b0 2021-02-06T22:54:46.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae36ffd700 1 -- 172.21.15.51:0/167359178 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae300048c0 con 0x7fae380976b0 2021-02-06T22:54:46.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae3e710700 1 -- 172.21.15.51:0/167359178 >> v1:172.21.15.51:6790/0 conn(0x7fae380976b0 legacy=0x7fae381331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae3e710700 1 -- 172.21.15.51:0/167359178 shutdown_connections 2021-02-06T22:54:46.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae3e710700 1 -- 172.21.15.51:0/167359178 >> 172.21.15.51:0/167359178 conn(0x7fae3809ae00 msgr2=0x7fae3809d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:46.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae3e710700 1 -- 172.21.15.51:0/167359178 shutdown_connections 2021-02-06T22:54:46.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.433+0000 7fae3e710700 1 -- 172.21.15.51:0/167359178 wait complete. 2021-02-06T22:54:46.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 librados: starting msgr at 2021-02-06T22:54:46.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 librados: starting objecter 2021-02-06T22:54:46.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 Processor -- start 2021-02-06T22:54:46.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 -- start start 2021-02-06T22:54:46.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 librados: setting wanted keys 2021-02-06T22:54:46.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.434+0000 7fae3e710700 1 librados: calling monclient init 2021-02-06T22:54:46.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae3e710700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380995a0 con 0x7fae38093e80 2021-02-06T22:54:46.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae3e710700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3812c110 con 0x7fae380976b0 2021-02-06T22:54:46.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae3e710700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3812c3b0 con 0x7fae38097200 2021-02-06T22:54:46.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae377fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fae38097200 0x7fae3813ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60530/0 (socket says 172.21.15.51:60530) 2021-02-06T22:54:46.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae377fe700 1 -- 172.21.15.51:0/1845505787 learned_addr learned my addr 172.21.15.51:0/1845505787 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:46.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.435+0000 7fae37fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 0x7fae381338c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60186/0 (socket says 172.21.15.51:60186) 2021-02-06T22:54:46.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae377fe700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.51:6790/0 conn(0x7fae38097200 legacy=0x7fae3813ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter ms_handle_connect 0x7fae38097200 2021-02-06T22:54:46.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:46.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae37fff700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 legacy=0x7fae381338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter ms_handle_connect 0x7fae38093e80 2021-02-06T22:54:46.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:46.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696214857 0 0) 0x7fae3812c3b0 con 0x7fae38097200 2021-02-06T22:54:46.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae18004bd0 con 0x7fae38097200 2021-02-06T22:54:46.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter ms_handle_connect 0x7fae380976b0 2021-02-06T22:54:46.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:46.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae3ccad700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.106:6789/0 conn(0x7fae380976b0 legacy=0x7fae38142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:46.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802778103 0 0) 0x7fae380995a0 con 0x7fae38093e80 2021-02-06T22:54:46.446 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae3812c3b0 con 0x7fae38093e80 2021-02-06T22:54:46.446 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108225641 0 0) 0x7fae3812c110 con 0x7fae380976b0 2021-02-06T22:54:46.446 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae380995a0 con 0x7fae380976b0 2021-02-06T22:54:46.446 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2577040071 0 0) 0x7fae18004bd0 con 0x7fae38097200 2021-02-06T22:54:46.446 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae3812c110 con 0x7fae38097200 2021-02-06T22:54:46.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae2c001ce0 con 0x7fae38097200 2021-02-06T22:54:46.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3612409109 0 0) 0x7fae3812c3b0 con 0x7fae38093e80 2021-02-06T22:54:46.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae18004bd0 con 0x7fae38093e80 2021-02-06T22:54:46.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae28001c60 con 0x7fae38093e80 2021-02-06T22:54:46.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1271868407 0 0) 0x7fae380995a0 con 0x7fae380976b0 2021-02-06T22:54:46.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae3812c3b0 con 0x7fae380976b0 2021-02-06T22:54:46.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.437+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae300048c0 con 0x7fae380976b0 2021-02-06T22:54:46.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2454845173 0 0) 0x7fae3812c110 con 0x7fae38097200 2021-02-06T22:54:46.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.106:6789/0 conn(0x7fae380976b0 legacy=0x7fae38142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.51:6789/0 conn(0x7fae38093e80 legacy=0x7fae381338c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3813a850 con 0x7fae38097200 2021-02-06T22:54:46.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3812a1d0 con 0x7fae38097200 2021-02-06T22:54:46.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae3e710700 10 client.4532.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:46.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fae38135180 con 0x7fae38097200 2021-02-06T22:54:46.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae3e710700 1 librados: init done 2021-02-06T22:54:46.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae2c002380 con 0x7fae38097200 2021-02-06T22:54:46.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae2c002690 con 0x7fae38097200 2021-02-06T22:54:46.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.438+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fae2c0027f0 con 0x7fae38097200 2021-02-06T22:54:46.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fae2c0394c0 con 0x7fae38097200 2021-02-06T22:54:46.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae1ffff700 10 client.4532.objecter ms_dispatch 0x7fae38001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:46.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae1ffff700 3 client.4532.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:46.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae1ffff700 3 client.4532.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:46.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae1ffff700 20 client.4532.objecter dump_active .. 0 homeless 2021-02-06T22:54:46.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.439+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3805cbd0 con 0x7fae38097200 2021-02-06T22:54:46.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.441+0000 7fae1ffff700 10 client.4532.objecter ms_handle_connect 0x7fae180306f0 2021-02-06T22:54:46.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.443+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fae2c012350 con 0x7fae38097200 2021-02-06T22:54:46.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.691+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fae380581b0 con 0x7fae38097200 2021-02-06T22:54:46.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.691+0000 7fae1ffff700 1 -- 172.21.15.51:0/1845505787 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fae2c011f40 con 0x7fae38097200 2021-02-06T22:54:46.691 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:46.692 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 10 librados: watch_flush enter 2021-02-06T22:54:46.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 10 librados: watch_flush exit 2021-02-06T22:54:46.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 20 client.4532.objecter shutdown clearing up homeless session... 2021-02-06T22:54:46.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 10 client.4532.objecter successfully canceled tick 2021-02-06T22:54:46.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.106:6812/33219 conn(0x7fae180306f0 legacy=0x7fae18032bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.694 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 >> v1:172.21.15.51:6790/0 conn(0x7fae38097200 legacy=0x7fae3813ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:46.694 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 shutdown_connections 2021-02-06T22:54:46.694 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 >> 172.21.15.51:0/1845505787 conn(0x7fae3809ae00 msgr2=0x7fae380951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:46.694 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 shutdown_connections 2021-02-06T22:54:46.695 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 -- 172.21.15.51:0/1845505787 wait complete. 2021-02-06T22:54:46.695 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:46.693+0000 7fae3e710700 1 librados: shutdown 2021-02-06T22:54:46.703 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:49.705 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:49.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f55652700 1 Processor -- start 2021-02-06T22:54:49.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f55652700 1 -- start start 2021-02-06T22:54:49.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f55652700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f50095050 con 0x7f6f500999a0 2021-02-06T22:54:49.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f55652700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f50128c00 con 0x7f6f50067a30 2021-02-06T22:54:49.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f55652700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f50095280 con 0x7f6f50067ec0 2021-02-06T22:54:49.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f4effd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f6f500999a0 0x7f6f501284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60212/0 (socket says 172.21.15.51:60212) 2021-02-06T22:54:49.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f4f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 0x7f6f50130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60554/0 (socket says 172.21.15.51:60554) 2021-02-06T22:54:49.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.840+0000 7f6f4effd700 1 -- 172.21.15.51:0/1152585237 learned_addr learned my addr 172.21.15.51:0/1152585237 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:49.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4f7fe700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 legacy=0x7f6f50130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4effd700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.51:6789/0 conn(0x7f6f500999a0 legacy=0x7f6f501284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3686678487 0 0) 0x7f6f50095280 con 0x7f6f50067ec0 2021-02-06T22:54:49.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f3c003230 con 0x7f6f50067ec0 2021-02-06T22:54:49.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219527800 0 0) 0x7f6f50095050 con 0x7f6f500999a0 2021-02-06T22:54:49.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f50095280 con 0x7f6f500999a0 2021-02-06T22:54:49.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4e7fc700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.106:6789/0 conn(0x7f6f50067a30 legacy=0x7f6f5012d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1337453032 0 0) 0x7f6f3c003230 con 0x7f6f50067ec0 2021-02-06T22:54:49.857 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.106:6789/0 conn(0x7f6f50067a30 legacy=0x7f6f5012d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:49.857 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.51:6789/0 conn(0x7f6f500999a0 legacy=0x7f6f501284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:49.857 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50095520 con 0x7f6f50067ec0 2021-02-06T22:54:49.858 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f48001cf0 con 0x7f6f50067ec0 2021-02-06T22:54:49.859 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4f7fe700 1 --1- 172.21.15.51:0/1152585237 >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 0x7f6f50130db0 :-1 s=OPENED pgs=199 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f6f48004a10 mon_map magic: 0 v1 2021-02-06T22:54:49.859 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.843+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6f48002000 con 0x7f6f50067ec0 2021-02-06T22:54:49.859 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f55652700 1 -- 172.21.15.51:0/1152585237 >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 legacy=0x7f6f50130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:49.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f4dffb700 1 -- 172.21.15.51:0/1152585237 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f48004a10 con 0x7f6f50067ec0 2021-02-06T22:54:49.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f55652700 1 -- 172.21.15.51:0/1152585237 shutdown_connections 2021-02-06T22:54:49.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f55652700 1 -- 172.21.15.51:0/1152585237 >> 172.21.15.51:0/1152585237 conn(0x7f6f50096860 msgr2=0x7f6f50099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:49.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f55652700 1 -- 172.21.15.51:0/1152585237 shutdown_connections 2021-02-06T22:54:49.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.844+0000 7f6f55652700 1 -- 172.21.15.51:0/1152585237 wait complete. 2021-02-06T22:54:49.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 librados: starting msgr at 2021-02-06T22:54:49.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 librados: starting objecter 2021-02-06T22:54:49.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 Processor -- start 2021-02-06T22:54:49.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 -- start start 2021-02-06T22:54:49.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 librados: setting wanted keys 2021-02-06T22:54:49.863 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 librados: calling monclient init 2021-02-06T22:54:49.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f50093230 con 0x7f6f500999a0 2021-02-06T22:54:49.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5012ef10 con 0x7f6f50067a30 2021-02-06T22:54:49.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f55652700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5012f1b0 con 0x7f6f50067ec0 2021-02-06T22:54:49.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f4e7fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 0x7f6f50137710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60560/0 (socket says 172.21.15.51:60560) 2021-02-06T22:54:49.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.845+0000 7f6f4e7fc700 1 -- 172.21.15.51:0/1824100723 learned_addr learned my addr 172.21.15.51:0/1824100723 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:49.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f4e7fc700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 legacy=0x7f6f50137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f4f7fe700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.51:6789/0 conn(0x7f6f500999a0 legacy=0x7f6f5013fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter ms_handle_connect 0x7f6f50067ec0 2021-02-06T22:54:49.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:49.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter ms_handle_connect 0x7f6f500999a0 2021-02-06T22:54:49.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:49.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664791608 0 0) 0x7f6f5012f1b0 con 0x7f6f50067ec0 2021-02-06T22:54:49.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f30004bd0 con 0x7f6f50067ec0 2021-02-06T22:54:49.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321011981 0 0) 0x7f6f50093230 con 0x7f6f500999a0 2021-02-06T22:54:49.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5012f1b0 con 0x7f6f500999a0 2021-02-06T22:54:49.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter ms_handle_connect 0x7f6f50067a30 2021-02-06T22:54:49.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:49.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f4effd700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.106:6789/0 conn(0x7f6f50067a30 legacy=0x7f6f50131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:49.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1069799715 0 0) 0x7f6f30004bd0 con 0x7f6f50067ec0 2021-02-06T22:54:49.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f50093230 con 0x7f6f50067ec0 2021-02-06T22:54:49.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f40001c00 con 0x7f6f50067ec0 2021-02-06T22:54:49.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 488194803 0 0) 0x7f6f5012f1b0 con 0x7f6f500999a0 2021-02-06T22:54:49.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f30004bd0 con 0x7f6f500999a0 2021-02-06T22:54:49.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734770280 0 0) 0x7f6f5012ef10 con 0x7f6f50067a30 2021-02-06T22:54:49.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5012f1b0 con 0x7f6f50067a30 2021-02-06T22:54:49.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f48001b50 con 0x7f6f500999a0 2021-02-06T22:54:49.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 707646593 0 0) 0x7f6f50093230 con 0x7f6f50067ec0 2021-02-06T22:54:49.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.106:6789/0 conn(0x7f6f50067a30 legacy=0x7f6f50131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:49.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.51:6789/0 conn(0x7f6f500999a0 legacy=0x7f6f5013fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:49.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50131d80 con 0x7f6f50067ec0 2021-02-06T22:54:49.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50131f70 con 0x7f6f50067ec0 2021-02-06T22:54:49.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f55652700 10 client.4538.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:49.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f50137fe0 con 0x7f6f50067ec0 2021-02-06T22:54:49.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f55652700 1 librados: init done 2021-02-06T22:54:49.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6f40002290 con 0x7f6f50067ec0 2021-02-06T22:54:49.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.848+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f400025a0 con 0x7f6f50067ec0 2021-02-06T22:54:49.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f6f40002780 con 0x7f6f50067ec0 2021-02-06T22:54:49.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f6f40039440 con 0x7f6f50067ec0 2021-02-06T22:54:49.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 10 client.4538.objecter ms_dispatch 0x7f6f50001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:49.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 3 client.4538.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:49.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 3 client.4538.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:49.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f28004d60 con 0x7f6f50067ec0 2021-02-06T22:54:49.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.849+0000 7f6f36ffd700 20 client.4538.objecter dump_active .. 0 homeless 2021-02-06T22:54:49.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.852+0000 7f6f36ffd700 10 client.4538.objecter ms_handle_connect 0x7f6f300309c0 2021-02-06T22:54:49.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:49.853+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f6f40012350 con 0x7f6f50067ec0 2021-02-06T22:54:50.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.103+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6f280059b0 con 0x7f6f50067ec0 2021-02-06T22:54:50.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.103+0000 7f6f36ffd700 1 -- 172.21.15.51:0/1824100723 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f6f40011f40 con 0x7f6f50067ec0 2021-02-06T22:54:50.104 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:50.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 10 librados: watch_flush enter 2021-02-06T22:54:50.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 10 librados: watch_flush exit 2021-02-06T22:54:50.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 20 client.4538.objecter shutdown clearing up homeless session... 2021-02-06T22:54:50.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 10 client.4538.objecter successfully canceled tick 2021-02-06T22:54:50.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.106:6812/33219 conn(0x7f6f300309c0 legacy=0x7f6f30032e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:50.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 >> v1:172.21.15.51:6790/0 conn(0x7f6f50067ec0 legacy=0x7f6f50137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:50.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 shutdown_connections 2021-02-06T22:54:50.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 >> 172.21.15.51:0/1824100723 conn(0x7f6f50096860 msgr2=0x7f6f50098430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:50.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 shutdown_connections 2021-02-06T22:54:50.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 -- 172.21.15.51:0/1824100723 wait complete. 2021-02-06T22:54:50.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:50.105+0000 7f6f55652700 1 librados: shutdown 2021-02-06T22:54:50.116 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:53.117 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:53.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.251+0000 7fb6597f1700 1 Processor -- start 2021-02-06T22:54:53.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.251+0000 7fb6597f1700 1 -- start start 2021-02-06T22:54:53.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.252+0000 7fb6597f1700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb654095440 con 0x7fb65412ce00 2021-02-06T22:54:53.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.252+0000 7fb6597f1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540907b0 con 0x7fb65408fa70 2021-02-06T22:54:53.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.252+0000 7fb6597f1700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb654091010 con 0x7fb654092bf0 2021-02-06T22:54:53.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.252+0000 7fb6527fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fb654092bf0 0x7fb6540930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60574/0 (socket says 172.21.15.51:60574) 2021-02-06T22:54:53.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.252+0000 7fb6527fc700 1 -- 172.21.15.51:0/4264305824 learned_addr learned my addr 172.21.15.51:0/4264305824 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:53.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.254+0000 7fb6537fe700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.51:6789/0 conn(0x7fb65412ce00 legacy=0x7fb65412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.254+0000 7fb6527fc700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.51:6790/0 conn(0x7fb654092bf0 legacy=0x7fb6540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb652ffd700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.106:6789/0 conn(0x7fb65408fa70 legacy=0x7fb6540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672351189 0 0) 0x7fb654095440 con 0x7fb65412ce00 2021-02-06T22:54:53.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb640003230 con 0x7fb65412ce00 2021-02-06T22:54:53.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125326247 0 0) 0x7fb654091010 con 0x7fb654092bf0 2021-02-06T22:54:53.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb654095440 con 0x7fb654092bf0 2021-02-06T22:54:53.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927326851 0 0) 0x7fb6540907b0 con 0x7fb65408fa70 2021-02-06T22:54:53.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb654091010 con 0x7fb65408fa70 2021-02-06T22:54:53.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2703786057 0 0) 0x7fb640003230 con 0x7fb65412ce00 2021-02-06T22:54:53.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.51:6790/0 conn(0x7fb654092bf0 legacy=0x7fb6540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.106:6789/0 conn(0x7fb65408fa70 legacy=0x7fb6540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540912b0 con 0x7fb65412ce00 2021-02-06T22:54:53.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb64c001d00 con 0x7fb65412ce00 2021-02-06T22:54:53.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb64c002010 con 0x7fb65412ce00 2021-02-06T22:54:53.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb651ffb700 1 -- 172.21.15.51:0/4264305824 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb64c0023e0 con 0x7fb65412ce00 2021-02-06T22:54:53.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.255+0000 7fb6597f1700 1 -- 172.21.15.51:0/4264305824 >> v1:172.21.15.51:6789/0 conn(0x7fb65412ce00 legacy=0x7fb65412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 -- 172.21.15.51:0/4264305824 shutdown_connections 2021-02-06T22:54:53.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 -- 172.21.15.51:0/4264305824 >> 172.21.15.51:0/4264305824 conn(0x7fb654096860 msgr2=0x7fb654099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:53.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 -- 172.21.15.51:0/4264305824 shutdown_connections 2021-02-06T22:54:53.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 -- 172.21.15.51:0/4264305824 wait complete. 2021-02-06T22:54:53.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 librados: starting msgr at 2021-02-06T22:54:53.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.256+0000 7fb6597f1700 1 librados: starting objecter 2021-02-06T22:54:53.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 Processor -- start 2021-02-06T22:54:53.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 -- start start 2021-02-06T22:54:53.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 librados: setting wanted keys 2021-02-06T22:54:53.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 librados: calling monclient init 2021-02-06T22:54:53.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb654119560 con 0x7fb654092bf0 2021-02-06T22:54:53.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb654066d80 con 0x7fb65408fa70 2021-02-06T22:54:53.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6597f1700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65411a150 con 0x7fb65412ce00 2021-02-06T22:54:53.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6527fc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb654092bf0 0x7fb65413ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60236/0 (socket says 172.21.15.51:60236) 2021-02-06T22:54:53.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6527fc700 1 -- 172.21.15.51:0/1701750653 learned_addr learned my addr 172.21.15.51:0/1701750653 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:53.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.257+0000 7fb6537fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fb65412ce00 0x7fb654142400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60580/0 (socket says 172.21.15.51:60580) 2021-02-06T22:54:53.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb6537fe700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.51:6790/0 conn(0x7fb65412ce00 legacy=0x7fb654142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb6527fc700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.51:6789/0 conn(0x7fb654092bf0 legacy=0x7fb65413ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb63affd700 10 client.?.objecter ms_handle_connect 0x7fb65412ce00 2021-02-06T22:54:53.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb63affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:53.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb63affd700 10 client.?.objecter ms_handle_connect 0x7fb654092bf0 2021-02-06T22:54:53.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.259+0000 7fb63affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:53.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 10 client.?.objecter ms_handle_connect 0x7fb65408fa70 2021-02-06T22:54:53.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:53.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb652ffd700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.106:6789/0 conn(0x7fb65408fa70 legacy=0x7fb65412c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:53.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836461007 0 0) 0x7fb65411a150 con 0x7fb65412ce00 2021-02-06T22:54:53.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb634004bd0 con 0x7fb65412ce00 2021-02-06T22:54:53.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781579519 0 0) 0x7fb654119560 con 0x7fb654092bf0 2021-02-06T22:54:53.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb65411a150 con 0x7fb654092bf0 2021-02-06T22:54:53.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722371303 0 0) 0x7fb654066d80 con 0x7fb65408fa70 2021-02-06T22:54:53.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb654119560 con 0x7fb65408fa70 2021-02-06T22:54:53.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1272322312 0 0) 0x7fb634004bd0 con 0x7fb65412ce00 2021-02-06T22:54:53.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb654066d80 con 0x7fb65412ce00 2021-02-06T22:54:53.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb64c001cc0 con 0x7fb65412ce00 2021-02-06T22:54:53.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3460622732 0 0) 0x7fb65411a150 con 0x7fb654092bf0 2021-02-06T22:54:53.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb634004bd0 con 0x7fb654092bf0 2021-02-06T22:54:53.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb648001bb0 con 0x7fb654092bf0 2021-02-06T22:54:53.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2384261480 0 0) 0x7fb654119560 con 0x7fb65408fa70 2021-02-06T22:54:53.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb65411a150 con 0x7fb65408fa70 2021-02-06T22:54:53.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb644001be0 con 0x7fb65408fa70 2021-02-06T22:54:53.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 756017374 0 0) 0x7fb654066d80 con 0x7fb65412ce00 2021-02-06T22:54:53.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.106:6789/0 conn(0x7fb65408fa70 legacy=0x7fb65412c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.51:6789/0 conn(0x7fb654092bf0 legacy=0x7fb65413ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb654097190 con 0x7fb65412ce00 2021-02-06T22:54:53.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb654098d10 con 0x7fb65412ce00 2021-02-06T22:54:53.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb6597f1700 10 client.4544.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:53.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb654136660 con 0x7fb65412ce00 2021-02-06T22:54:53.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb6597f1700 1 librados: init done 2021-02-06T22:54:53.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb64c002980 con 0x7fb65412ce00 2021-02-06T22:54:53.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.260+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb64c002c90 con 0x7fb65412ce00 2021-02-06T22:54:53.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fb64c002e70 con 0x7fb65412ce00 2021-02-06T22:54:53.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fb64c0398a0 con 0x7fb65412ce00 2021-02-06T22:54:53.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 10 client.4544.objecter ms_dispatch 0x7fb654001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:53.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 3 client.4544.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:53.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 3 client.4544.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:53.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb63affd700 20 client.4544.objecter dump_active .. 0 homeless 2021-02-06T22:54:53.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.261+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c004d60 con 0x7fb65412ce00 2021-02-06T22:54:53.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.264+0000 7fb63affd700 10 client.4544.objecter ms_handle_connect 0x7fb634030800 2021-02-06T22:54:53.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.265+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fb64c012850 con 0x7fb65412ce00 2021-02-06T22:54:53.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.516+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb62c0059b0 con 0x7fb65412ce00 2021-02-06T22:54:53.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.516+0000 7fb63affd700 1 -- 172.21.15.51:0/1701750653 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fb64c012440 con 0x7fb65412ce00 2021-02-06T22:54:53.517 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:53.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 10 librados: watch_flush enter 2021-02-06T22:54:53.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 10 librados: watch_flush exit 2021-02-06T22:54:53.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 20 client.4544.objecter shutdown clearing up homeless session... 2021-02-06T22:54:53.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 10 client.4544.objecter successfully canceled tick 2021-02-06T22:54:53.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.106:6812/33219 conn(0x7fb634030800 legacy=0x7fb634032cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 >> v1:172.21.15.51:6790/0 conn(0x7fb65412ce00 legacy=0x7fb654142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:53.520 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 shutdown_connections 2021-02-06T22:54:53.520 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 >> 172.21.15.51:0/1701750653 conn(0x7fb654096860 msgr2=0x7fb654066220 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:53.520 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 shutdown_connections 2021-02-06T22:54:53.520 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 -- 172.21.15.51:0/1701750653 wait complete. 2021-02-06T22:54:53.520 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:53.518+0000 7fb6597f1700 1 librados: shutdown 2021-02-06T22:54:53.529 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:56.531 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:54:56.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.665+0000 7fcadeb61700 1 Processor -- start 2021-02-06T22:54:56.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.665+0000 7fcadeb61700 1 -- start start 2021-02-06T22:54:56.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcadeb61700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad80998a0 con 0x7fcad80976b0 2021-02-06T22:54:56.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcadeb61700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8099b10 con 0x7fcad8093e80 2021-02-06T22:54:56.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcadeb61700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8099db0 con 0x7fcad8097200 2021-02-06T22:54:56.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcadd0fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fcad80976b0 0x7fcad81331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60252/0 (socket says 172.21.15.51:60252) 2021-02-06T22:54:56.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcadd0fe700 1 -- 172.21.15.51:0/589672462 learned_addr learned my addr 172.21.15.51:0/589672462 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:56.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.666+0000 7fcad7fff700 1 --1- 172.21.15.51:0/589672462 >> v1:172.21.15.51:6790/0 conn(0x7fcad8097200 0x7fcad812fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60592/0 (socket says 172.21.15.51:60592) 2021-02-06T22:54:56.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcad7fff700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.51:6790/0 conn(0x7fcad8097200 legacy=0x7fcad812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcadd0fe700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.51:6789/0 conn(0x7fcad80976b0 legacy=0x7fcad81331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230782696 0 0) 0x7fcad80998a0 con 0x7fcad80976b0 2021-02-06T22:54:56.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcadc8fd700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.106:6789/0 conn(0x7fcad8093e80 legacy=0x7fcad81278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc003230 con 0x7fcad80976b0 2021-02-06T22:54:56.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840939786 0 0) 0x7fcad8099db0 con 0x7fcad8097200 2021-02-06T22:54:56.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.668+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad80998a0 con 0x7fcad8097200 2021-02-06T22:54:56.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942624704 0 0) 0x7fcad8099b10 con 0x7fcad8093e80 2021-02-06T22:54:56.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad8099db0 con 0x7fcad8093e80 2021-02-06T22:54:56.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1654426586 0 0) 0x7fcabc003230 con 0x7fcad80976b0 2021-02-06T22:54:56.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.51:6790/0 conn(0x7fcad8097200 legacy=0x7fcad812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.106:6789/0 conn(0x7fcad8093e80 legacy=0x7fcad81278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8127480 con 0x7fcad80976b0 2021-02-06T22:54:56.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad0001c30 con 0x7fcad80976b0 2021-02-06T22:54:56.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcad0001f40 con 0x7fcad80976b0 2021-02-06T22:54:56.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcad77fe700 1 -- 172.21.15.51:0/589672462 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad0004980 con 0x7fcad80976b0 2021-02-06T22:54:56.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcadeb61700 1 -- 172.21.15.51:0/589672462 >> v1:172.21.15.51:6789/0 conn(0x7fcad80976b0 legacy=0x7fcad81331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcadeb61700 1 -- 172.21.15.51:0/589672462 shutdown_connections 2021-02-06T22:54:56.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcadeb61700 1 -- 172.21.15.51:0/589672462 >> 172.21.15.51:0/589672462 conn(0x7fcad809ae00 msgr2=0x7fcad809d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:56.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcadeb61700 1 -- 172.21.15.51:0/589672462 shutdown_connections 2021-02-06T22:54:56.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.669+0000 7fcadeb61700 1 -- 172.21.15.51:0/589672462 wait complete. 2021-02-06T22:54:56.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 librados: starting msgr at 2021-02-06T22:54:56.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 librados: starting objecter 2021-02-06T22:54:56.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 Processor -- start 2021-02-06T22:54:56.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 -- start start 2021-02-06T22:54:56.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 librados: setting wanted keys 2021-02-06T22:54:56.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.670+0000 7fcadeb61700 1 librados: calling monclient init 2021-02-06T22:54:56.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.671+0000 7fcadeb61700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8126a60 con 0x7fcad8093e80 2021-02-06T22:54:56.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.671+0000 7fcadeb61700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8122b90 con 0x7fcad8097200 2021-02-06T22:54:56.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.671+0000 7fcadeb61700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad8122e30 con 0x7fcad80976b0 2021-02-06T22:54:56.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.671+0000 7fcadc8fd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fcad8093e80 0x7fcad81335b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60254/0 (socket says 172.21.15.51:60254) 2021-02-06T22:54:56.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.671+0000 7fcadc8fd700 1 -- 172.21.15.51:0/2325714624 learned_addr learned my addr 172.21.15.51:0/2325714624 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:54:56.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcadc8fd700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.51:6789/0 conn(0x7fcad8093e80 legacy=0x7fcad81335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.680 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter ms_handle_connect 0x7fcad8093e80 2021-02-06T22:54:56.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:56.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcadd0fe700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.51:6790/0 conn(0x7fcad80976b0 legacy=0x7fcad8142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter ms_handle_connect 0x7fcad80976b0 2021-02-06T22:54:56.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:56.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801574001 0 0) 0x7fcad8126a60 con 0x7fcad8093e80 2021-02-06T22:54:56.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab8004bd0 con 0x7fcad8093e80 2021-02-06T22:54:56.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694695733 0 0) 0x7fcad8122e30 con 0x7fcad80976b0 2021-02-06T22:54:56.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad8126a60 con 0x7fcad80976b0 2021-02-06T22:54:56.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter ms_handle_connect 0x7fcad8097200 2021-02-06T22:54:56.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:54:56.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.673+0000 7fcad7fff700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.106:6789/0 conn(0x7fcad8097200 legacy=0x7fcad8133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:54:56.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1589451383 0 0) 0x7fcad8126a60 con 0x7fcad80976b0 2021-02-06T22:54:56.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcad8122e30 con 0x7fcad80976b0 2021-02-06T22:54:56.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad0001a50 con 0x7fcad80976b0 2021-02-06T22:54:56.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4135785647 0 0) 0x7fcab8004bd0 con 0x7fcad8093e80 2021-02-06T22:54:56.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcad8126a60 con 0x7fcad8093e80 2021-02-06T22:54:56.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326699658 0 0) 0x7fcad8122b90 con 0x7fcad8097200 2021-02-06T22:54:56.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab8004bd0 con 0x7fcad8097200 2021-02-06T22:54:56.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcacc001c40 con 0x7fcad8093e80 2021-02-06T22:54:56.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 294420027 0 0) 0x7fcad8122e30 con 0x7fcad80976b0 2021-02-06T22:54:56.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.106:6789/0 conn(0x7fcad8097200 legacy=0x7fcad8133cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.51:6789/0 conn(0x7fcad8093e80 legacy=0x7fcad81335b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad8120cc0 con 0x7fcad80976b0 2021-02-06T22:54:56.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad8120330 con 0x7fcad80976b0 2021-02-06T22:54:56.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcadeb61700 10 client.4550.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:54:56.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad8123790 con 0x7fcad80976b0 2021-02-06T22:54:56.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcadeb61700 1 librados: init done 2021-02-06T22:54:56.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcad0001bb0 con 0x7fcad80976b0 2021-02-06T22:54:56.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.674+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcad0005270 con 0x7fcad80976b0 2021-02-06T22:54:56.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fcad000da70 con 0x7fcad80976b0 2021-02-06T22:54:56.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fcad00397b0 con 0x7fcad80976b0 2021-02-06T22:54:56.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 10 client.4550.objecter ms_dispatch 0x7fcad8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:54:56.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 3 client.4550.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:54:56.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 3 client.4550.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:54:56.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcad4ff9700 20 client.4550.objecter dump_active .. 0 homeless 2021-02-06T22:54:56.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.675+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab0004d60 con 0x7fcad80976b0 2021-02-06T22:54:56.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.677+0000 7fcad4ff9700 10 client.4550.objecter ms_handle_connect 0x7fcab8030700 2021-02-06T22:54:56.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.679+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fcad0012590 con 0x7fcad80976b0 2021-02-06T22:54:56.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.926+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcab00059b0 con 0x7fcad80976b0 2021-02-06T22:54:56.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.926+0000 7fcad4ff9700 1 -- 172.21.15.51:0/2325714624 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fcad00123b0 con 0x7fcad80976b0 2021-02-06T22:54:56.927 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:54:56.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.927+0000 7fcadeb61700 10 librados: watch_flush enter 2021-02-06T22:54:56.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.927+0000 7fcadeb61700 10 librados: watch_flush exit 2021-02-06T22:54:56.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.927+0000 7fcadeb61700 20 client.4550.objecter shutdown clearing up homeless session... 2021-02-06T22:54:56.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.927+0000 7fcadeb61700 10 client.4550.objecter successfully canceled tick 2021-02-06T22:54:56.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.106:6812/33219 conn(0x7fcab8030700 legacy=0x7fcab8032bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 >> v1:172.21.15.51:6790/0 conn(0x7fcad80976b0 legacy=0x7fcad8142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:54:56.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 shutdown_connections 2021-02-06T22:54:56.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 >> 172.21.15.51:0/2325714624 conn(0x7fcad809ae00 msgr2=0x7fcad80951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:54:56.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 shutdown_connections 2021-02-06T22:54:56.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 -- 172.21.15.51:0/2325714624 wait complete. 2021-02-06T22:54:56.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:54:56.928+0000 7fcadeb61700 1 librados: shutdown 2021-02-06T22:54:56.939 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:54:59.941 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:00.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.075+0000 7f8b566c3700 1 Processor -- start 2021-02-06T22:55:00.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.075+0000 7f8b566c3700 1 -- start start 2021-02-06T22:55:00.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.075+0000 7f8b566c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b500953e0 con 0x7f8b5012cd50 2021-02-06T22:55:00.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.075+0000 7f8b566c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b50094900 con 0x7f8b5008f510 2021-02-06T22:55:00.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.075+0000 7f8b566c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b50090dd0 con 0x7f8b50091f60 2021-02-06T22:55:00.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.076+0000 7f8b55ec2700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8b5012cd50 0x7f8b5012f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60274/0 (socket says 172.21.15.51:60274) 2021-02-06T22:55:00.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.076+0000 7f8b55ec2700 1 -- 172.21.15.51:0/2857863662 learned_addr learned my addr 172.21.15.51:0/2857863662 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:00.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.076+0000 7f8b54ec0700 1 --1- 172.21.15.51:0/2857863662 >> v1:172.21.15.51:6790/0 conn(0x7f8b50091f60 0x7f8b500941f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60614/0 (socket says 172.21.15.51:60614) 2021-02-06T22:55:00.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b54ec0700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.51:6790/0 conn(0x7f8b50091f60 legacy=0x7f8b500941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b55ec2700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.51:6789/0 conn(0x7f8b5012cd50 legacy=0x7f8b5012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078586999 0 0) 0x7f8b50090dd0 con 0x7f8b50091f60 2021-02-06T22:55:00.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b38003230 con 0x7f8b50091f60 2021-02-06T22:55:00.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290638759 0 0) 0x7f8b500953e0 con 0x7f8b5012cd50 2021-02-06T22:55:00.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b556c1700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.106:6789/0 conn(0x7f8b5008f510 legacy=0x7f8b50093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50090dd0 con 0x7f8b5012cd50 2021-02-06T22:55:00.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3461230475 0 0) 0x7f8b38003230 con 0x7f8b50091f60 2021-02-06T22:55:00.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.106:6789/0 conn(0x7f8b5008f510 legacy=0x7f8b50093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.51:6789/0 conn(0x7f8b5012cd50 legacy=0x7f8b5012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50091070 con 0x7f8b50091f60 2021-02-06T22:55:00.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b40001930 con 0x7f8b50091f60 2021-02-06T22:55:00.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8b40001c40 con 0x7f8b50091f60 2021-02-06T22:55:00.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.078+0000 7f8b3ffff700 1 -- 172.21.15.51:0/2857863662 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b40004690 con 0x7f8b50091f60 2021-02-06T22:55:00.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.079+0000 7f8b566c3700 1 -- 172.21.15.51:0/2857863662 >> v1:172.21.15.51:6790/0 conn(0x7f8b50091f60 legacy=0x7f8b500941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.079+0000 7f8b566c3700 1 -- 172.21.15.51:0/2857863662 shutdown_connections 2021-02-06T22:55:00.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.079+0000 7f8b566c3700 1 -- 172.21.15.51:0/2857863662 >> 172.21.15.51:0/2857863662 conn(0x7f8b50095be0 msgr2=0x7f8b50095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:00.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.079+0000 7f8b566c3700 1 -- 172.21.15.51:0/2857863662 shutdown_connections 2021-02-06T22:55:00.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.079+0000 7f8b566c3700 1 -- 172.21.15.51:0/2857863662 wait complete. 2021-02-06T22:55:00.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 librados: starting msgr at 2021-02-06T22:55:00.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 librados: starting objecter 2021-02-06T22:55:00.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 Processor -- start 2021-02-06T22:55:00.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 -- start start 2021-02-06T22:55:00.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 librados: setting wanted keys 2021-02-06T22:55:00.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.080+0000 7f8b566c3700 1 librados: calling monclient init 2021-02-06T22:55:00.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b566c3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b50114250 con 0x7f8b50091f60 2021-02-06T22:55:00.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b566c3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b501144f0 con 0x7f8b5008f510 2021-02-06T22:55:00.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b566c3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b50131980 con 0x7f8b5012cd50 2021-02-06T22:55:00.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b54ec0700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8b50091f60 0x7f8b5013eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60278/0 (socket says 172.21.15.51:60278) 2021-02-06T22:55:00.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b54ec0700 1 -- 172.21.15.51:0/1676986530 learned_addr learned my addr 172.21.15.51:0/1676986530 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:00.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.081+0000 7f8b55ec2700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8b5012cd50 0x7f8b50142260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60622/0 (socket says 172.21.15.51:60622) 2021-02-06T22:55:00.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter ms_handle_connect 0x7f8b50091f60 2021-02-06T22:55:00.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:00.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter ms_handle_connect 0x7f8b5012cd50 2021-02-06T22:55:00.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:00.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b54ec0700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.51:6789/0 conn(0x7f8b50091f60 legacy=0x7f8b5013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b55ec2700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.51:6790/0 conn(0x7f8b5012cd50 legacy=0x7f8b50142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter ms_handle_connect 0x7f8b5008f510 2021-02-06T22:55:00.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:00.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b556c1700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.106:6789/0 conn(0x7f8b5008f510 legacy=0x7f8b50139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:00.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871806464 0 0) 0x7f8b501144f0 con 0x7f8b5008f510 2021-02-06T22:55:00.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30004bd0 con 0x7f8b5008f510 2021-02-06T22:55:00.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830618480 0 0) 0x7f8b50114250 con 0x7f8b50091f60 2021-02-06T22:55:00.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.083+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b501144f0 con 0x7f8b50091f60 2021-02-06T22:55:00.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233205229 0 0) 0x7f8b50131980 con 0x7f8b5012cd50 2021-02-06T22:55:00.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50114250 con 0x7f8b5012cd50 2021-02-06T22:55:00.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3263029300 0 0) 0x7f8b30004bd0 con 0x7f8b5008f510 2021-02-06T22:55:00.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b50131980 con 0x7f8b5008f510 2021-02-06T22:55:00.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b4c001b60 con 0x7f8b5008f510 2021-02-06T22:55:00.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2268914141 0 0) 0x7f8b501144f0 con 0x7f8b50091f60 2021-02-06T22:55:00.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b30004bd0 con 0x7f8b50091f60 2021-02-06T22:55:00.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b40004690 con 0x7f8b50091f60 2021-02-06T22:55:00.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3854303490 0 0) 0x7f8b50114250 con 0x7f8b5012cd50 2021-02-06T22:55:00.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8b501144f0 con 0x7f8b5012cd50 2021-02-06T22:55:00.094 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b48001fe0 con 0x7f8b5012cd50 2021-02-06T22:55:00.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 131606964 0 0) 0x7f8b30004bd0 con 0x7f8b50091f60 2021-02-06T22:55:00.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.51:6790/0 conn(0x7f8b5012cd50 legacy=0x7f8b50142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.106:6789/0 conn(0x7f8b5008f510 legacy=0x7f8b50139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b50132620 con 0x7f8b50091f60 2021-02-06T22:55:00.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5013a530 con 0x7f8b50091f60 2021-02-06T22:55:00.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b566c3700 10 client.4575.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:00.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b501339d0 con 0x7f8b50091f60 2021-02-06T22:55:00.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b566c3700 1 librados: init done 2021-02-06T22:55:00.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8b40001560 con 0x7f8b50091f60 2021-02-06T22:55:00.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.084+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8b40004f00 con 0x7f8b50091f60 2021-02-06T22:55:00.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f8b4000d6c0 con 0x7f8b50091f60 2021-02-06T22:55:00.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f8b40039640 con 0x7f8b50091f60 2021-02-06T22:55:00.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 10 client.4575.objecter ms_dispatch 0x7f8b50001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:00.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 3 client.4575.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:00.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 3 client.4575.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:00.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b3d7fa700 20 client.4575.objecter dump_active .. 0 homeless 2021-02-06T22:55:00.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.085+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28004d60 con 0x7f8b50091f60 2021-02-06T22:55:00.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.088+0000 7f8b3d7fa700 10 client.4575.objecter ms_handle_connect 0x7f8b30030770 2021-02-06T22:55:00.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.089+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f8b40012590 con 0x7f8b50091f60 2021-02-06T22:55:00.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.339+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8b280059b0 con 0x7f8b50091f60 2021-02-06T22:55:00.340 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.340+0000 7f8b3d7fa700 1 -- 172.21.15.51:0/1676986530 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f8b40012180 con 0x7f8b50091f60 2021-02-06T22:55:00.340 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:00.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 10 librados: watch_flush enter 2021-02-06T22:55:00.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 10 librados: watch_flush exit 2021-02-06T22:55:00.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 20 client.4575.objecter shutdown clearing up homeless session... 2021-02-06T22:55:00.342 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 10 client.4575.objecter successfully canceled tick 2021-02-06T22:55:00.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.106:6812/33219 conn(0x7f8b30030770 legacy=0x7f8b30032c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 >> v1:172.21.15.51:6789/0 conn(0x7f8b50091f60 legacy=0x7f8b5013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:00.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 shutdown_connections 2021-02-06T22:55:00.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 >> 172.21.15.51:0/1676986530 conn(0x7f8b50095be0 msgr2=0x7f8b500923c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:00.343 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 shutdown_connections 2021-02-06T22:55:00.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 -- 172.21.15.51:0/1676986530 wait complete. 2021-02-06T22:55:00.344 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:00.341+0000 7f8b566c3700 1 librados: shutdown 2021-02-06T22:55:00.352 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:03.353 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:03.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e9328b700 1 Processor -- start 2021-02-06T22:55:03.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e9328b700 1 -- start start 2021-02-06T22:55:03.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e9328b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c095440 con 0x7f4e8c092bf0 2021-02-06T22:55:03.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e9328b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c0907b0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e9328b700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c091010 con 0x7f4e8c12ce00 2021-02-06T22:55:03.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e90826700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4e8c092bf0 0x7f4e8c0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60292/0 (socket says 172.21.15.51:60292) 2021-02-06T22:55:03.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.490+0000 7f4e91828700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 0x7f4e8c12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60636/0 (socket says 172.21.15.51:60636) 2021-02-06T22:55:03.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.491+0000 7f4e90826700 1 -- 172.21.15.51:0/3913839718 learned_addr learned my addr 172.21.15.51:0/3913839718 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:03.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e91828700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 legacy=0x7f4e8c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e90826700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.51:6789/0 conn(0x7f4e8c092bf0 legacy=0x7f4e8c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553843674 0 0) 0x7f4e8c091010 con 0x7f4e8c12ce00 2021-02-06T22:55:03.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e74003230 con 0x7f4e8c12ce00 2021-02-06T22:55:03.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841948892 0 0) 0x7f4e8c095440 con 0x7f4e8c092bf0 2021-02-06T22:55:03.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c091010 con 0x7f4e8c092bf0 2021-02-06T22:55:03.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e91027700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.106:6789/0 conn(0x7f4e8c08fa70 legacy=0x7f4e8c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1771847825 0 0) 0x7f4e74003230 con 0x7f4e8c12ce00 2021-02-06T22:55:03.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.106:6789/0 conn(0x7f4e8c08fa70 legacy=0x7f4e8c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.51:6789/0 conn(0x7f4e8c092bf0 legacy=0x7f4e8c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c0912b0 con 0x7f4e8c12ce00 2021-02-06T22:55:03.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e84001cb0 con 0x7f4e8c12ce00 2021-02-06T22:55:03.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e91828700 1 --1- 172.21.15.51:0/3913839718 >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 0x7f4e8c12f1f0 :-1 s=OPENED pgs=209 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f4e84004a10 mon_map magic: 0 v1 2021-02-06T22:55:03.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.493+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e84001fc0 con 0x7f4e8c12ce00 2021-02-06T22:55:03.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e9328b700 1 -- 172.21.15.51:0/3913839718 >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 legacy=0x7f4e8c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e7bfff700 1 -- 172.21.15.51:0/3913839718 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e84004a10 con 0x7f4e8c12ce00 2021-02-06T22:55:03.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e9328b700 1 -- 172.21.15.51:0/3913839718 shutdown_connections 2021-02-06T22:55:03.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e9328b700 1 -- 172.21.15.51:0/3913839718 >> 172.21.15.51:0/3913839718 conn(0x7f4e8c096860 msgr2=0x7f4e8c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:03.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e9328b700 1 -- 172.21.15.51:0/3913839718 shutdown_connections 2021-02-06T22:55:03.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.494+0000 7f4e9328b700 1 -- 172.21.15.51:0/3913839718 wait complete. 2021-02-06T22:55:03.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 librados: starting msgr at 2021-02-06T22:55:03.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 librados: starting objecter 2021-02-06T22:55:03.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 Processor -- start 2021-02-06T22:55:03.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 -- start start 2021-02-06T22:55:03.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 librados: setting wanted keys 2021-02-06T22:55:03.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 librados: calling monclient init 2021-02-06T22:55:03.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c130b00 con 0x7f4e8c08fa70 2021-02-06T22:55:03.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c090bf0 con 0x7f4e8c092bf0 2021-02-06T22:55:03.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e9328b700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c097d70 con 0x7f4e8c12ce00 2021-02-06T22:55:03.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e91027700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4e8c08fa70 0x7f4e8c131390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60296/0 (socket says 172.21.15.51:60296) 2021-02-06T22:55:03.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.495+0000 7f4e91027700 1 -- 172.21.15.51:0/1873232864 learned_addr learned my addr 172.21.15.51:0/1873232864 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:03.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e91027700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.51:6789/0 conn(0x7f4e8c08fa70 legacy=0x7f4e8c131390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter ms_handle_connect 0x7f4e8c08fa70 2021-02-06T22:55:03.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:03.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter ms_handle_connect 0x7f4e8c12ce00 2021-02-06T22:55:03.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:03.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e91828700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 legacy=0x7f4e8c138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956918139 0 0) 0x7f4e8c130b00 con 0x7f4e8c08fa70 2021-02-06T22:55:03.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c004bd0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053379578 0 0) 0x7f4e8c097d70 con 0x7f4e8c12ce00 2021-02-06T22:55:03.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c130b00 con 0x7f4e8c12ce00 2021-02-06T22:55:03.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter ms_handle_connect 0x7f4e8c092bf0 2021-02-06T22:55:03.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:03.506 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e90826700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.106:6789/0 conn(0x7f4e8c092bf0 legacy=0x7f4e8c137b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3922701435 0 0) 0x7f4e6c004bd0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e8c097d70 con 0x7f4e8c08fa70 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e7c001b50 con 0x7f4e8c08fa70 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3565707726 0 0) 0x7f4e8c130b00 con 0x7f4e8c12ce00 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e6c004bd0 con 0x7f4e8c12ce00 2021-02-06T22:55:03.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251813939 0 0) 0x7f4e8c090bf0 con 0x7f4e8c092bf0 2021-02-06T22:55:03.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8c130b00 con 0x7f4e8c092bf0 2021-02-06T22:55:03.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e84001660 con 0x7f4e8c12ce00 2021-02-06T22:55:03.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2467816944 0 0) 0x7f4e8c097d70 con 0x7f4e8c08fa70 2021-02-06T22:55:03.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.51:6790/0 conn(0x7f4e8c12ce00 legacy=0x7f4e8c138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.106:6789/0 conn(0x7f4e8c092bf0 legacy=0x7f4e8c137b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c12ea20 con 0x7f4e8c08fa70 2021-02-06T22:55:03.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c12e1f0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e9328b700 10 client.4581.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:03.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c140bf0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e9328b700 1 librados: init done 2021-02-06T22:55:03.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4e7c002230 con 0x7f4e8c08fa70 2021-02-06T22:55:03.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.498+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4e7c002540 con 0x7f4e8c08fa70 2021-02-06T22:55:03.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4e7c002720 con 0x7f4e8c08fa70 2021-02-06T22:55:03.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f4e7c0394a0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 10 client.4581.objecter ms_dispatch 0x7f4e8c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:03.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 3 client.4581.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:03.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 3 client.4581.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:03.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e797fa700 20 client.4581.objecter dump_active .. 0 homeless 2021-02-06T22:55:03.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.499+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e64004d60 con 0x7f4e8c08fa70 2021-02-06T22:55:03.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.502+0000 7f4e797fa700 10 client.4581.objecter ms_handle_connect 0x7f4e6c030820 2021-02-06T22:55:03.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.503+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4e7c002ce0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.752+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4e640059b0 con 0x7f4e8c08fa70 2021-02-06T22:55:03.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.753+0000 7f4e797fa700 1 -- 172.21.15.51:0/1873232864 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f4e7c011f80 con 0x7f4e8c08fa70 2021-02-06T22:55:03.753 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:03.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 10 librados: watch_flush enter 2021-02-06T22:55:03.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 10 librados: watch_flush exit 2021-02-06T22:55:03.755 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 20 client.4581.objecter shutdown clearing up homeless session... 2021-02-06T22:55:03.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 10 client.4581.objecter successfully canceled tick 2021-02-06T22:55:03.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.106:6812/33219 conn(0x7f4e6c030820 legacy=0x7f4e6c032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 >> v1:172.21.15.51:6789/0 conn(0x7f4e8c08fa70 legacy=0x7f4e8c131390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:03.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 shutdown_connections 2021-02-06T22:55:03.756 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.754+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 >> 172.21.15.51:0/1873232864 conn(0x7f4e8c096860 msgr2=0x7f4e8c093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:03.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.755+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 shutdown_connections 2021-02-06T22:55:03.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.755+0000 7f4e9328b700 1 -- 172.21.15.51:0/1873232864 wait complete. 2021-02-06T22:55:03.757 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:03.755+0000 7f4e9328b700 1 librados: shutdown 2021-02-06T22:55:03.766 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:06.767 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:06.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7ee89700 1 Processor -- start 2021-02-06T22:55:06.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7ee89700 1 -- start start 2021-02-06T22:55:06.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7ee89700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78095440 con 0x7fcb7808fa70 2021-02-06T22:55:06.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7ee89700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb780907b0 con 0x7fcb78092bf0 2021-02-06T22:55:06.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7ee89700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78091010 con 0x7fcb7812ce00 2021-02-06T22:55:06.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7d426700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcb7812ce00 0x7fcb7812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60656/0 (socket says 172.21.15.51:60656) 2021-02-06T22:55:06.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7cc25700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fcb7808fa70 0x7fcb780921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60310/0 (socket says 172.21.15.51:60310) 2021-02-06T22:55:06.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.902+0000 7fcb7d426700 1 -- 172.21.15.51:0/77915888 learned_addr learned my addr 172.21.15.51:0/77915888 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:06.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.904+0000 7fcb7d426700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.51:6790/0 conn(0x7fcb7812ce00 legacy=0x7fcb7812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.904+0000 7fcb7cc25700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.51:6789/0 conn(0x7fcb7808fa70 legacy=0x7fcb780921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806695594 0 0) 0x7fcb78091010 con 0x7fcb7812ce00 2021-02-06T22:55:06.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb77fff700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.106:6789/0 conn(0x7fcb78092bf0 legacy=0x7fcb780930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c003230 con 0x7fcb7812ce00 2021-02-06T22:55:06.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029855180 0 0) 0x7fcb78095440 con 0x7fcb7808fa70 2021-02-06T22:55:06.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb78091010 con 0x7fcb7808fa70 2021-02-06T22:55:06.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 350601716 0 0) 0x7fcb5c003230 con 0x7fcb7812ce00 2021-02-06T22:55:06.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.106:6789/0 conn(0x7fcb78092bf0 legacy=0x7fcb780930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:06.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.51:6789/0 conn(0x7fcb7808fa70 legacy=0x7fcb780921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:06.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780912b0 con 0x7fcb7812ce00 2021-02-06T22:55:06.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcb70001cb0 con 0x7fcb7812ce00 2021-02-06T22:55:06.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb70001fc0 con 0x7fcb7812ce00 2021-02-06T22:55:06.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb777fe700 1 -- 172.21.15.51:0/77915888 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcb70004ad0 con 0x7fcb7812ce00 2021-02-06T22:55:06.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.905+0000 7fcb7ee89700 1 -- 172.21.15.51:0/77915888 >> v1:172.21.15.51:6790/0 conn(0x7fcb7812ce00 legacy=0x7fcb7812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:06.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 -- 172.21.15.51:0/77915888 shutdown_connections 2021-02-06T22:55:06.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 -- 172.21.15.51:0/77915888 >> 172.21.15.51:0/77915888 conn(0x7fcb78096860 msgr2=0x7fcb78099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:06.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 -- 172.21.15.51:0/77915888 shutdown_connections 2021-02-06T22:55:06.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 -- 172.21.15.51:0/77915888 wait complete. 2021-02-06T22:55:06.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 librados: starting msgr at 2021-02-06T22:55:06.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 librados: starting objecter 2021-02-06T22:55:06.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.906+0000 7fcb7ee89700 1 Processor -- start 2021-02-06T22:55:06.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 -- start start 2021-02-06T22:55:06.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 librados: setting wanted keys 2021-02-06T22:55:06.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 librados: calling monclient init 2021-02-06T22:55:06.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78139d80 con 0x7fcb78092bf0 2021-02-06T22:55:06.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78098d90 con 0x7fcb7808fa70 2021-02-06T22:55:06.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb7ee89700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb78090bf0 con 0x7fcb7812ce00 2021-02-06T22:55:06.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb77fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fcb78092bf0 0x7fcb7812aec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60318/0 (socket says 172.21.15.51:60318) 2021-02-06T22:55:06.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.907+0000 7fcb77fff700 1 -- 172.21.15.51:0/1644335076 learned_addr learned my addr 172.21.15.51:0/1644335076 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:06.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb77fff700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.51:6789/0 conn(0x7fcb78092bf0 legacy=0x7fcb7812aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 10 client.?.objecter ms_handle_connect 0x7fcb78092bf0 2021-02-06T22:55:06.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:06.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 10 client.?.objecter ms_handle_connect 0x7fcb7812ce00 2021-02-06T22:55:06.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:06.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb7d426700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.51:6790/0 conn(0x7fcb7812ce00 legacy=0x7fcb78141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 971902847 0 0) 0x7fcb640015b0 con 0x7fcb78092bf0 2021-02-06T22:55:06.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.909+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb58004bd0 con 0x7fcb78092bf0 2021-02-06T22:55:06.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458483090 0 0) 0x7fcb78090bf0 con 0x7fcb7812ce00 2021-02-06T22:55:06.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb640015b0 con 0x7fcb7812ce00 2021-02-06T22:55:06.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb7cc25700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.106:6789/0 conn(0x7fcb7808fa70 legacy=0x7fcb78139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:06.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 10 client.?.objecter ms_handle_connect 0x7fcb7808fa70 2021-02-06T22:55:06.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:06.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1655370822 0 0) 0x7fcb58004bd0 con 0x7fcb78092bf0 2021-02-06T22:55:06.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb78090bf0 con 0x7fcb78092bf0 2021-02-06T22:55:06.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcb64001c60 con 0x7fcb78092bf0 2021-02-06T22:55:06.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340917135 0 0) 0x7fcb78098d90 con 0x7fcb7808fa70 2021-02-06T22:55:06.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb58004bd0 con 0x7fcb7808fa70 2021-02-06T22:55:06.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1372015430 0 0) 0x7fcb640015b0 con 0x7fcb7812ce00 2021-02-06T22:55:06.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb78098d90 con 0x7fcb7812ce00 2021-02-06T22:55:06.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcb70001c70 con 0x7fcb7812ce00 2021-02-06T22:55:06.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 444714525 0 0) 0x7fcb78090bf0 con 0x7fcb78092bf0 2021-02-06T22:55:06.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.51:6790/0 conn(0x7fcb7812ce00 legacy=0x7fcb78141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:06.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.106:6789/0 conn(0x7fcb7808fa70 legacy=0x7fcb78139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:06.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7813a4d0 con 0x7fcb78092bf0 2021-02-06T22:55:06.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb78118280 con 0x7fcb78092bf0 2021-02-06T22:55:06.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb7ee89700 10 client.4587.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:06.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7812b5d0 con 0x7fcb78092bf0 2021-02-06T22:55:06.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb7ee89700 1 librados: init done 2021-02-06T22:55:06.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcb64002310 con 0x7fcb78092bf0 2021-02-06T22:55:06.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.910+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcb64002620 con 0x7fcb78092bf0 2021-02-06T22:55:06.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fcb64002800 con 0x7fcb78092bf0 2021-02-06T22:55:06.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fcb64039530 con 0x7fcb78092bf0 2021-02-06T22:55:06.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 10 client.4587.objecter ms_dispatch 0x7fcb78001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:06.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 3 client.4587.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:06.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50004d60 con 0x7fcb78092bf0 2021-02-06T22:55:06.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 3 client.4587.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:06.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.911+0000 7fcb74ff9700 20 client.4587.objecter dump_active .. 0 homeless 2021-02-06T22:55:06.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.914+0000 7fcb74ff9700 10 client.4587.objecter ms_handle_connect 0x7fcb58030760 2021-02-06T22:55:06.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:06.915+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fcb64012440 con 0x7fcb78092bf0 2021-02-06T22:55:07.165 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.165+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcb500059b0 con 0x7fcb78092bf0 2021-02-06T22:55:07.166 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.165+0000 7fcb74ff9700 1 -- 172.21.15.51:0/1644335076 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fcb64012030 con 0x7fcb78092bf0 2021-02-06T22:55:07.166 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:07.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 10 librados: watch_flush enter 2021-02-06T22:55:07.167 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 10 librados: watch_flush exit 2021-02-06T22:55:07.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 20 client.4587.objecter shutdown clearing up homeless session... 2021-02-06T22:55:07.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 10 client.4587.objecter successfully canceled tick 2021-02-06T22:55:07.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.106:6812/33219 conn(0x7fcb58030760 legacy=0x7fcb58032c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:07.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 >> v1:172.21.15.51:6789/0 conn(0x7fcb78092bf0 legacy=0x7fcb7812aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:07.168 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 shutdown_connections 2021-02-06T22:55:07.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 >> 172.21.15.51:0/1644335076 conn(0x7fcb78096860 msgr2=0x7fcb7812bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:07.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 shutdown_connections 2021-02-06T22:55:07.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 -- 172.21.15.51:0/1644335076 wait complete. 2021-02-06T22:55:07.169 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:07.167+0000 7fcb7ee89700 1 librados: shutdown 2021-02-06T22:55:07.178 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:10.179 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:10.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7cd150a700 1 Processor -- start 2021-02-06T22:55:10.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7cd150a700 1 -- start start 2021-02-06T22:55:10.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7cd150a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc095050 con 0x7f7ccc0999a0 2021-02-06T22:55:10.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7cd150a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc128c00 con 0x7f7ccc067a30 2021-02-06T22:55:10.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7cd150a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc095280 con 0x7f7ccc067ec0 2021-02-06T22:55:10.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7ccaffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f7ccc0999a0 0x7f7ccc1284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60334/0 (socket says 172.21.15.51:60334) 2021-02-06T22:55:10.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7ccaffd700 1 -- 172.21.15.51:0/3559931328 learned_addr learned my addr 172.21.15.51:0/3559931328 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:10.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.316+0000 7f7ccb7fe700 1 --1- 172.21.15.51:0/3559931328 >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 0x7f7ccc130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60678/0 (socket says 172.21.15.51:60678) 2021-02-06T22:55:10.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7ccb7fe700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 legacy=0x7f7ccc130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7ccaffd700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.51:6789/0 conn(0x7f7ccc0999a0 legacy=0x7f7ccc1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cca7fc700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.106:6789/0 conn(0x7f7ccc067a30 legacy=0x7f7ccc12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113775260 0 0) 0x7f7ccc095280 con 0x7f7ccc067ec0 2021-02-06T22:55:10.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cac003230 con 0x7f7ccc067ec0 2021-02-06T22:55:10.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951080145 0 0) 0x7f7ccc095050 con 0x7f7ccc0999a0 2021-02-06T22:55:10.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ccc095280 con 0x7f7ccc0999a0 2021-02-06T22:55:10.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049206103 0 0) 0x7f7ccc128c00 con 0x7f7ccc067a30 2021-02-06T22:55:10.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ccc095050 con 0x7f7ccc067a30 2021-02-06T22:55:10.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4242888484 0 0) 0x7f7cac003230 con 0x7f7ccc067ec0 2021-02-06T22:55:10.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.106:6789/0 conn(0x7f7ccc067a30 legacy=0x7f7ccc12d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.51:6789/0 conn(0x7f7ccc0999a0 legacy=0x7f7ccc1284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc095520 con 0x7f7ccc067ec0 2021-02-06T22:55:10.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7cc4001cf0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7cc4002000 con 0x7f7ccc067ec0 2021-02-06T22:55:10.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.319+0000 7f7cc9ffb700 1 -- 172.21.15.51:0/3559931328 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7cc4004a10 con 0x7f7ccc067ec0 2021-02-06T22:55:10.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.320+0000 7f7cd150a700 1 -- 172.21.15.51:0/3559931328 >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 legacy=0x7f7ccc130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.320+0000 7f7cd150a700 1 -- 172.21.15.51:0/3559931328 shutdown_connections 2021-02-06T22:55:10.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.320+0000 7f7cd150a700 1 -- 172.21.15.51:0/3559931328 >> 172.21.15.51:0/3559931328 conn(0x7f7ccc096860 msgr2=0x7f7ccc099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:10.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.320+0000 7f7cd150a700 1 -- 172.21.15.51:0/3559931328 shutdown_connections 2021-02-06T22:55:10.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.320+0000 7f7cd150a700 1 -- 172.21.15.51:0/3559931328 wait complete. 2021-02-06T22:55:10.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 librados: starting msgr at 2021-02-06T22:55:10.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 librados: starting objecter 2021-02-06T22:55:10.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 Processor -- start 2021-02-06T22:55:10.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 -- start start 2021-02-06T22:55:10.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 librados: setting wanted keys 2021-02-06T22:55:10.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.321+0000 7f7cd150a700 1 librados: calling monclient init 2021-02-06T22:55:10.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.322+0000 7f7cd150a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc0909e0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.322+0000 7f7cd150a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc065b70 con 0x7f7ccc067a30 2021-02-06T22:55:10.329 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.322+0000 7f7cd150a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ccc0665e0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.322+0000 7f7cca7fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 0x7f7ccc139a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60684/0 (socket says 172.21.15.51:60684) 2021-02-06T22:55:10.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.322+0000 7f7cca7fc700 1 -- 172.21.15.51:0/3381045217 learned_addr learned my addr 172.21.15.51:0/3381045217 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:10.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7ccb7fe700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.51:6789/0 conn(0x7f7ccc0999a0 legacy=0x7f7ccc141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cca7fc700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 legacy=0x7f7ccc139a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter ms_handle_connect 0x7f7ccc0999a0 2021-02-06T22:55:10.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:10.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter ms_handle_connect 0x7f7ccc067ec0 2021-02-06T22:55:10.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:10.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7ccaffd700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.106:6789/0 conn(0x7f7ccc067a30 legacy=0x7f7ccc091e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:10.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241424951 0 0) 0x7f7ccc0909e0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb0004bd0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter ms_handle_connect 0x7f7ccc067a30 2021-02-06T22:55:10.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:10.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518350438 0 0) 0x7f7ccc0665e0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ccc0909e0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333737943 0 0) 0x7f7ccc065b70 con 0x7f7ccc067a30 2021-02-06T22:55:10.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ccc0665e0 con 0x7f7ccc067a30 2021-02-06T22:55:10.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3082491410 0 0) 0x7f7cb0004bd0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.333 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7ccc065b70 con 0x7f7ccc0999a0 2021-02-06T22:55:10.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7cc4001cb0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1055088969 0 0) 0x7f7ccc0909e0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7cb0004bd0 con 0x7f7ccc067ec0 2021-02-06T22:55:10.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7cbc001c60 con 0x7f7ccc067ec0 2021-02-06T22:55:10.334 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1493542725 0 0) 0x7f7ccc065b70 con 0x7f7ccc0999a0 2021-02-06T22:55:10.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.51:6790/0 conn(0x7f7ccc067ec0 legacy=0x7f7ccc139a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.106:6789/0 conn(0x7f7ccc067a30 legacy=0x7f7ccc091e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.324+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0925a0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ccc0927f0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.335 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cd150a700 10 client.4593.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:10.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ccc13a330 con 0x7f7ccc0999a0 2021-02-06T22:55:10.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cd150a700 1 librados: init done 2021-02-06T22:55:10.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7cc4001920 con 0x7f7ccc0999a0 2021-02-06T22:55:10.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7cc40051a0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.336 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f7cc400d960 con 0x7f7ccc0999a0 2021-02-06T22:55:10.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f7cc4039890 con 0x7f7ccc0999a0 2021-02-06T22:55:10.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 10 client.4593.objecter ms_dispatch 0x7f7ccc001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:10.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 3 client.4593.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:10.337 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cc2ffd700 3 client.4593.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:10.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.325+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4004d60 con 0x7f7ccc0999a0 2021-02-06T22:55:10.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.326+0000 7f7cc2ffd700 20 client.4593.objecter dump_active .. 0 homeless 2021-02-06T22:55:10.338 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.328+0000 7f7cc2ffd700 10 client.4593.objecter ms_handle_connect 0x7f7cb00304d0 2021-02-06T22:55:10.339 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.330+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f7cc40127e0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.580+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7ca40059b0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.581+0000 7f7cc2ffd700 1 -- 172.21.15.51:0/3381045217 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f7cc40123d0 con 0x7f7ccc0999a0 2021-02-06T22:55:10.581 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:10.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 10 librados: watch_flush enter 2021-02-06T22:55:10.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 10 librados: watch_flush exit 2021-02-06T22:55:10.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 20 client.4593.objecter shutdown clearing up homeless session... 2021-02-06T22:55:10.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 10 client.4593.objecter successfully canceled tick 2021-02-06T22:55:10.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.106:6812/33219 conn(0x7f7cb00304d0 legacy=0x7f7cb0032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 >> v1:172.21.15.51:6789/0 conn(0x7f7ccc0999a0 legacy=0x7f7ccc141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:10.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 shutdown_connections 2021-02-06T22:55:10.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 >> 172.21.15.51:0/3381045217 conn(0x7f7ccc096860 msgr2=0x7f7ccc097d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:10.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 shutdown_connections 2021-02-06T22:55:10.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 -- 172.21.15.51:0/3381045217 wait complete. 2021-02-06T22:55:10.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:10.582+0000 7f7cd150a700 1 librados: shutdown 2021-02-06T22:55:10.594 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:13.595 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:13.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.730+0000 7f0742bce700 1 Processor -- start 2021-02-06T22:55:13.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.730+0000 7f0742bce700 1 -- start start 2021-02-06T22:55:13.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f0742bce700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c08ef70 con 0x7f073c0908f0 2021-02-06T22:55:13.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f0742bce700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c08f440 con 0x7f073c062530 2021-02-06T22:55:13.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f0742bce700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0620b0 con 0x7f073c090d50 2021-02-06T22:55:13.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f073bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f073c0908f0 0x7f073c12fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60350/0 (socket says 172.21.15.51:60350) 2021-02-06T22:55:13.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f074116b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f073c090d50 0x7f073c1331e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60696/0 (socket says 172.21.15.51:60696) 2021-02-06T22:55:13.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.731+0000 7f073bfff700 1 -- 172.21.15.51:0/1869644947 learned_addr learned my addr 172.21.15.51:0/1869644947 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:13.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073bfff700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.51:6789/0 conn(0x7f073c0908f0 legacy=0x7f073c12fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f074116b700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.51:6790/0 conn(0x7f073c090d50 legacy=0x7f073c1331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265514140 0 0) 0x7f073c08ef70 con 0x7f073c0908f0 2021-02-06T22:55:13.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0720003230 con 0x7f073c0908f0 2021-02-06T22:55:13.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f074096a700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.106:6789/0 conn(0x7f073c062530 legacy=0x7f073c0619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4156842739 0 0) 0x7f0720003230 con 0x7f073c0908f0 2021-02-06T22:55:13.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.51:6790/0 conn(0x7f073c090d50 legacy=0x7f073c1331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:13.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.106:6789/0 conn(0x7f073c062530 legacy=0x7f073c0619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:13.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c096470 con 0x7f073c0908f0 2021-02-06T22:55:13.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.733+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0728001930 con 0x7f073c0908f0 2021-02-06T22:55:13.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0728001c40 con 0x7f073c0908f0 2021-02-06T22:55:13.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f073b7fe700 1 -- 172.21.15.51:0/1869644947 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0728004750 con 0x7f073c0908f0 2021-02-06T22:55:13.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f0742bce700 1 -- 172.21.15.51:0/1869644947 >> v1:172.21.15.51:6789/0 conn(0x7f073c0908f0 legacy=0x7f073c12fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:13.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f0742bce700 1 -- 172.21.15.51:0/1869644947 shutdown_connections 2021-02-06T22:55:13.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f0742bce700 1 -- 172.21.15.51:0/1869644947 >> 172.21.15.51:0/1869644947 conn(0x7f073c09b010 msgr2=0x7f073c096e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:13.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f0742bce700 1 -- 172.21.15.51:0/1869644947 shutdown_connections 2021-02-06T22:55:13.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.734+0000 7f0742bce700 1 -- 172.21.15.51:0/1869644947 wait complete. 2021-02-06T22:55:13.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 librados: starting msgr at 2021-02-06T22:55:13.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 librados: starting objecter 2021-02-06T22:55:13.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 Processor -- start 2021-02-06T22:55:13.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 -- start start 2021-02-06T22:55:13.744 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 librados: setting wanted keys 2021-02-06T22:55:13.744 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.735+0000 7f0742bce700 1 librados: calling monclient init 2021-02-06T22:55:13.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.736+0000 7f0742bce700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c121f20 con 0x7f073c090d50 2021-02-06T22:55:13.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.736+0000 7f0742bce700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c127570 con 0x7f073c0908f0 2021-02-06T22:55:13.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.736+0000 7f0742bce700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c123470 con 0x7f073c062530 2021-02-06T22:55:13.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.736+0000 7f074096a700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f073c062530 0x7f073c124920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60698/0 (socket says 172.21.15.51:60698) 2021-02-06T22:55:13.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.736+0000 7f074096a700 1 -- 172.21.15.51:0/1343124072 learned_addr learned my addr 172.21.15.51:0/1343124072 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:13.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f074116b700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.51:6789/0 conn(0x7f073c090d50 legacy=0x7f073c142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f074096a700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.51:6790/0 conn(0x7f073c062530 legacy=0x7f073c124920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter ms_handle_connect 0x7f073c090d50 2021-02-06T22:55:13.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:13.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter ms_handle_connect 0x7f073c062530 2021-02-06T22:55:13.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:13.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337532632 0 0) 0x7f073c121f20 con 0x7f073c090d50 2021-02-06T22:55:13.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c004bd0 con 0x7f073c090d50 2021-02-06T22:55:13.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter ms_handle_connect 0x7f073c0908f0 2021-02-06T22:55:13.750 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:13.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f073bfff700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.106:6789/0 conn(0x7f073c0908f0 legacy=0x7f073c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:13.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f074116b700 1 --1- 172.21.15.51:0/1343124072 >> v1:172.21.15.51:6789/0 conn(0x7f073c090d50 0x7f073c142050 :-1 s=OPENED pgs=234 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f0734001eb0 mon_map magic: 0 v1 2021-02-06T22:55:13.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3113123961 0 0) 0x7f071c004bd0 con 0x7f073c090d50 2021-02-06T22:55:13.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f073c121f20 con 0x7f073c090d50 2021-02-06T22:55:13.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.738+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0734001eb0 con 0x7f073c090d50 2021-02-06T22:55:13.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933747168 0 0) 0x7f073c123470 con 0x7f073c062530 2021-02-06T22:55:13.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c004bd0 con 0x7f073c062530 2021-02-06T22:55:13.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2941409997 0 0) 0x7f071c004bd0 con 0x7f073c062530 2021-02-06T22:55:13.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f073c123470 con 0x7f073c062530 2021-02-06T22:55:13.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0730001b60 con 0x7f073c062530 2021-02-06T22:55:13.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996460437 0 0) 0x7f073c127570 con 0x7f073c0908f0 2021-02-06T22:55:13.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c004bd0 con 0x7f073c0908f0 2021-02-06T22:55:13.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3470283365 0 0) 0x7f073c123470 con 0x7f073c062530 2021-02-06T22:55:13.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.790+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.106:6789/0 conn(0x7f073c0908f0 legacy=0x7f073c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:13.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.51:6789/0 conn(0x7f073c090d50 legacy=0x7f073c142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:13.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c12b350 con 0x7f073c062530 2021-02-06T22:55:13.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3678045580 0 0) 0x7f073c121f20 con 0x7f073c090d50 2021-02-06T22:55:13.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c125030 con 0x7f073c062530 2021-02-06T22:55:13.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0742bce700 10 client.4577.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:13.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c13a5f0 con 0x7f073c062530 2021-02-06T22:55:13.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0742bce700 1 librados: init done 2021-02-06T22:55:13.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0730002270 con 0x7f073c062530 2021-02-06T22:55:13.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0730002580 con 0x7f073c062530 2021-02-06T22:55:13.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f07300026e0 con 0x7f073c062530 2021-02-06T22:55:13.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f07300393b0 con 0x7f073c062530 2021-02-06T22:55:13.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 10 client.4577.objecter ms_dispatch 0x7f073c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:13.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 3 client.4577.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:13.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.791+0000 7f0738ff9700 3 client.4577.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:13.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.792+0000 7f0738ff9700 20 client.4577.objecter dump_active .. 0 homeless 2021-02-06T22:55:13.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.792+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714004d60 con 0x7f073c062530 2021-02-06T22:55:13.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.794+0000 7f0738ff9700 10 client.4577.objecter ms_handle_connect 0x7f071c0306b0 2021-02-06T22:55:13.798 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:13.797+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0730002ca0 con 0x7f073c062530 2021-02-06T22:55:14.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.043+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f07140059b0 con 0x7f073c062530 2021-02-06T22:55:14.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.044+0000 7f0738ff9700 1 -- 172.21.15.51:0/1343124072 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0730011e30 con 0x7f073c062530 2021-02-06T22:55:14.044 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:14.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 10 librados: watch_flush enter 2021-02-06T22:55:14.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 10 librados: watch_flush exit 2021-02-06T22:55:14.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 20 client.4577.objecter shutdown clearing up homeless session... 2021-02-06T22:55:14.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 10 client.4577.objecter successfully canceled tick 2021-02-06T22:55:14.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.106:6812/33219 conn(0x7f071c0306b0 legacy=0x7f071c032b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:14.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 >> v1:172.21.15.51:6790/0 conn(0x7f073c062530 legacy=0x7f073c124920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:14.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 shutdown_connections 2021-02-06T22:55:14.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.045+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 >> 172.21.15.51:0/1343124072 conn(0x7f073c09b010 msgr2=0x7f073c121580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:14.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.046+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 shutdown_connections 2021-02-06T22:55:14.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.046+0000 7f0742bce700 1 -- 172.21.15.51:0/1343124072 wait complete. 2021-02-06T22:55:14.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:14.046+0000 7f0742bce700 1 librados: shutdown 2021-02-06T22:55:14.057 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:17.058 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:17.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.193+0000 7fd65ba0d700 1 Processor -- start 2021-02-06T22:55:17.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd65ba0d700 1 -- start start 2021-02-06T22:55:17.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd65ba0d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd654095440 con 0x7fd654092bf0 2021-02-06T22:55:17.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd65ba0d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540907b0 con 0x7fd65408fa70 2021-02-06T22:55:17.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd65ba0d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd654091010 con 0x7fd65412ce00 2021-02-06T22:55:17.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd659faa700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 0x7fd65412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60716/0 (socket says 172.21.15.51:60716) 2021-02-06T22:55:17.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd658fa8700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 0x7fd6540930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60372/0 (socket says 172.21.15.51:60372) 2021-02-06T22:55:17.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.194+0000 7fd659faa700 1 -- 172.21.15.51:0/3377110787 learned_addr learned my addr 172.21.15.51:0/3377110787 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:17.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd658fa8700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 legacy=0x7fd6540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd659faa700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 legacy=0x7fd65412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd6597a9700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.106:6789/0 conn(0x7fd65408fa70 legacy=0x7fd6540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972171299 0 0) 0x7fd654095440 con 0x7fd654092bf0 2021-02-06T22:55:17.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd63c003230 con 0x7fd654092bf0 2021-02-06T22:55:17.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174184287 0 0) 0x7fd654091010 con 0x7fd65412ce00 2021-02-06T22:55:17.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd654095440 con 0x7fd65412ce00 2021-02-06T22:55:17.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 355356766 0 0) 0x7fd63c003230 con 0x7fd654092bf0 2021-02-06T22:55:17.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 legacy=0x7fd65412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.106:6789/0 conn(0x7fd65408fa70 legacy=0x7fd6540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540912b0 con 0x7fd654092bf0 2021-02-06T22:55:17.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd6500019f0 con 0x7fd654092bf0 2021-02-06T22:55:17.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd650001c90 con 0x7fd654092bf0 2021-02-06T22:55:17.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.197+0000 7fd643fff700 1 -- 172.21.15.51:0/3377110787 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd650004690 con 0x7fd654092bf0 2021-02-06T22:55:17.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.198+0000 7fd65ba0d700 1 -- 172.21.15.51:0/3377110787 >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 legacy=0x7fd6540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.198+0000 7fd65ba0d700 1 -- 172.21.15.51:0/3377110787 shutdown_connections 2021-02-06T22:55:17.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.198+0000 7fd65ba0d700 1 -- 172.21.15.51:0/3377110787 >> 172.21.15.51:0/3377110787 conn(0x7fd654096860 msgr2=0x7fd654099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:17.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.198+0000 7fd65ba0d700 1 -- 172.21.15.51:0/3377110787 shutdown_connections 2021-02-06T22:55:17.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.198+0000 7fd65ba0d700 1 -- 172.21.15.51:0/3377110787 wait complete. 2021-02-06T22:55:17.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 librados: starting msgr at 2021-02-06T22:55:17.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 librados: starting objecter 2021-02-06T22:55:17.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 Processor -- start 2021-02-06T22:55:17.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 -- start start 2021-02-06T22:55:17.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 librados: setting wanted keys 2021-02-06T22:55:17.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 librados: calling monclient init 2021-02-06T22:55:17.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65410fc40 con 0x7fd654092bf0 2021-02-06T22:55:17.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65412b390 con 0x7fd65408fa70 2021-02-06T22:55:17.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd65ba0d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd654111af0 con 0x7fd65412ce00 2021-02-06T22:55:17.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd659faa700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 0x7fd654142300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60722/0 (socket says 172.21.15.51:60722) 2021-02-06T22:55:17.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd659faa700 1 -- 172.21.15.51:0/2646115111 learned_addr learned my addr 172.21.15.51:0/2646115111 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:17.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.199+0000 7fd658fa8700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 0x7fd65412ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60376/0 (socket says 172.21.15.51:60376) 2021-02-06T22:55:17.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd659faa700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 legacy=0x7fd654142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter ms_handle_connect 0x7fd65412ce00 2021-02-06T22:55:17.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd658fa8700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 legacy=0x7fd65412ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:17.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter ms_handle_connect 0x7fd654092bf0 2021-02-06T22:55:17.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:17.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185071682 0 0) 0x7fd654111af0 con 0x7fd65412ce00 2021-02-06T22:55:17.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6597a9700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.106:6789/0 conn(0x7fd65408fa70 legacy=0x7fd65412a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:17.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd634004bd0 con 0x7fd65412ce00 2021-02-06T22:55:17.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter ms_handle_connect 0x7fd65408fa70 2021-02-06T22:55:17.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:17.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989309050 0 0) 0x7fd65410fc40 con 0x7fd654092bf0 2021-02-06T22:55:17.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd654111af0 con 0x7fd654092bf0 2021-02-06T22:55:17.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207505393 0 0) 0x7fd65412b390 con 0x7fd65408fa70 2021-02-06T22:55:17.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd65410fc40 con 0x7fd65408fa70 2021-02-06T22:55:17.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1243891273 0 0) 0x7fd634004bd0 con 0x7fd65412ce00 2021-02-06T22:55:17.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd65412b390 con 0x7fd65412ce00 2021-02-06T22:55:17.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd64c0020b0 con 0x7fd65412ce00 2021-02-06T22:55:17.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3929216221 0 0) 0x7fd654111af0 con 0x7fd654092bf0 2021-02-06T22:55:17.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd634004bd0 con 0x7fd654092bf0 2021-02-06T22:55:17.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd650004690 con 0x7fd654092bf0 2021-02-06T22:55:17.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 162284856 0 0) 0x7fd65410fc40 con 0x7fd65408fa70 2021-02-06T22:55:17.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd654111af0 con 0x7fd65408fa70 2021-02-06T22:55:17.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd644001be0 con 0x7fd65408fa70 2021-02-06T22:55:17.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 334899537 0 0) 0x7fd65412b390 con 0x7fd65412ce00 2021-02-06T22:55:17.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.106:6789/0 conn(0x7fd65408fa70 legacy=0x7fd65412a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.51:6789/0 conn(0x7fd654092bf0 legacy=0x7fd65412ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654111d90 con 0x7fd65412ce00 2021-02-06T22:55:17.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6541121b0 con 0x7fd65412ce00 2021-02-06T22:55:17.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd65ba0d700 10 client.4583.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:17.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.202+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654123830 con 0x7fd65412ce00 2021-02-06T22:55:17.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd65ba0d700 1 librados: init done 2021-02-06T22:55:17.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd64c001c00 con 0x7fd65412ce00 2021-02-06T22:55:17.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fd64c004d80 con 0x7fd65412ce00 2021-02-06T22:55:17.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fd64c00d5c0 con 0x7fd65412ce00 2021-02-06T22:55:17.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fd64c039690 con 0x7fd65412ce00 2021-02-06T22:55:17.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 10 client.4583.objecter ms_dispatch 0x7fd654001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:17.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 3 client.4583.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:17.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 3 client.4583.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:17.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd6417fa700 20 client.4583.objecter dump_active .. 0 homeless 2021-02-06T22:55:17.218 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.203+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62c004d60 con 0x7fd65412ce00 2021-02-06T22:55:17.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.206+0000 7fd6417fa700 10 client.4583.objecter ms_handle_connect 0x7fd634030790 2021-02-06T22:55:17.219 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.207+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fd64c012520 con 0x7fd65412ce00 2021-02-06T22:55:17.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.465+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd62c0059b0 con 0x7fd65412ce00 2021-02-06T22:55:17.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.465+0000 7fd6417fa700 1 -- 172.21.15.51:0/2646115111 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fd64c012110 con 0x7fd65412ce00 2021-02-06T22:55:17.465 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:17.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 10 librados: watch_flush enter 2021-02-06T22:55:17.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 10 librados: watch_flush exit 2021-02-06T22:55:17.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 20 client.4583.objecter shutdown clearing up homeless session... 2021-02-06T22:55:17.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 10 client.4583.objecter successfully canceled tick 2021-02-06T22:55:17.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.106:6812/33219 conn(0x7fd634030790 legacy=0x7fd634032c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 >> v1:172.21.15.51:6790/0 conn(0x7fd65412ce00 legacy=0x7fd654142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:17.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 shutdown_connections 2021-02-06T22:55:17.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 >> 172.21.15.51:0/2646115111 conn(0x7fd654096860 msgr2=0x7fd65412bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:17.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 shutdown_connections 2021-02-06T22:55:17.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 -- 172.21.15.51:0/2646115111 wait complete. 2021-02-06T22:55:17.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:17.467+0000 7fd65ba0d700 1 librados: shutdown 2021-02-06T22:55:17.477 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:20.479 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:20.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.614+0000 7f92f1f9c700 1 Processor -- start 2021-02-06T22:55:20.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.614+0000 7f92f1f9c700 1 -- start start 2021-02-06T22:55:20.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.614+0000 7f92f1f9c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec095440 con 0x7f92ec08fa70 2021-02-06T22:55:20.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.614+0000 7f92f1f9c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec0907b0 con 0x7f92ec092bf0 2021-02-06T22:55:20.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.614+0000 7f92f1f9c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec091010 con 0x7f92ec12ce00 2021-02-06T22:55:20.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.615+0000 7f92ebfff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f92ec12ce00 0x7f92ec12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60726/0 (socket says 172.21.15.51:60726) 2021-02-06T22:55:20.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.615+0000 7f92ebfff700 1 -- 172.21.15.51:0/3103978551 learned_addr learned my addr 172.21.15.51:0/3103978551 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:20.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92eb7fe700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.51:6789/0 conn(0x7f92ec08fa70 legacy=0x7f92ec0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ebfff700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.51:6790/0 conn(0x7f92ec12ce00 legacy=0x7f92ec12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250340506 0 0) 0x7f92ec091010 con 0x7f92ec12ce00 2021-02-06T22:55:20.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92eaffd700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.106:6789/0 conn(0x7f92ec092bf0 legacy=0x7f92ec0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92d8003230 con 0x7f92ec12ce00 2021-02-06T22:55:20.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535089891 0 0) 0x7f92ec095440 con 0x7f92ec08fa70 2021-02-06T22:55:20.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec091010 con 0x7f92ec08fa70 2021-02-06T22:55:20.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3339749964 0 0) 0x7f92d8003230 con 0x7f92ec12ce00 2021-02-06T22:55:20.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.106:6789/0 conn(0x7f92ec092bf0 legacy=0x7f92ec0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.51:6789/0 conn(0x7f92ec08fa70 legacy=0x7f92ec0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0912b0 con 0x7f92ec12ce00 2021-02-06T22:55:20.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f92e4001cb0 con 0x7f92ec12ce00 2021-02-06T22:55:20.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ebfff700 1 --1- 172.21.15.51:0/3103978551 >> v1:172.21.15.51:6790/0 conn(0x7f92ec12ce00 0x7f92ec12f1f0 :-1 s=OPENED pgs=223 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f92e4001fc0 config(0 keys) v1 2021-02-06T22:55:20.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.617+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f92e4001fc0 con 0x7f92ec12ce00 2021-02-06T22:55:20.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92f1f9c700 1 -- 172.21.15.51:0/3103978551 >> v1:172.21.15.51:6790/0 conn(0x7f92ec12ce00 legacy=0x7f92ec12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92ea7fc700 1 -- 172.21.15.51:0/3103978551 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f92e4004ad0 con 0x7f92ec12ce00 2021-02-06T22:55:20.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92f1f9c700 1 -- 172.21.15.51:0/3103978551 shutdown_connections 2021-02-06T22:55:20.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92f1f9c700 1 -- 172.21.15.51:0/3103978551 >> 172.21.15.51:0/3103978551 conn(0x7f92ec096860 msgr2=0x7f92ec099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:20.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92f1f9c700 1 -- 172.21.15.51:0/3103978551 shutdown_connections 2021-02-06T22:55:20.621 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.618+0000 7f92f1f9c700 1 -- 172.21.15.51:0/3103978551 wait complete. 2021-02-06T22:55:20.625 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 librados: starting msgr at 2021-02-06T22:55:20.625 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 librados: starting objecter 2021-02-06T22:55:20.626 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 Processor -- start 2021-02-06T22:55:20.626 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 -- start start 2021-02-06T22:55:20.626 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 librados: setting wanted keys 2021-02-06T22:55:20.626 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.619+0000 7f92f1f9c700 1 librados: calling monclient init 2021-02-06T22:55:20.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.620+0000 7f92f1f9c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec113b00 con 0x7f92ec092bf0 2021-02-06T22:55:20.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.620+0000 7f92f1f9c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec113da0 con 0x7f92ec12ce00 2021-02-06T22:55:20.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.620+0000 7f92f1f9c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec114040 con 0x7f92ec08fa70 2021-02-06T22:55:20.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.620+0000 7f92eb7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f92ec08fa70 0x7f92ec1103c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60732/0 (socket says 172.21.15.51:60732) 2021-02-06T22:55:20.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.620+0000 7f92eb7fe700 1 -- 172.21.15.51:0/1312948848 learned_addr learned my addr 172.21.15.51:0/1312948848 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:20.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92eb7fe700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.51:6790/0 conn(0x7f92ec08fa70 legacy=0x7f92ec1103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter ms_handle_connect 0x7f92ec08fa70 2021-02-06T22:55:20.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:20.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter ms_handle_connect 0x7f92ec092bf0 2021-02-06T22:55:20.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:20.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92eaffd700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.51:6789/0 conn(0x7f92ec092bf0 legacy=0x7f92ec110ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666076235 0 0) 0x7f92ec114040 con 0x7f92ec08fa70 2021-02-06T22:55:20.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92cc004bd0 con 0x7f92ec08fa70 2021-02-06T22:55:20.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052290234 0 0) 0x7f92ec113b00 con 0x7f92ec092bf0 2021-02-06T22:55:20.630 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec114040 con 0x7f92ec092bf0 2021-02-06T22:55:20.630 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter ms_handle_connect 0x7f92ec12ce00 2021-02-06T22:55:20.630 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:20.630 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92ebfff700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.106:6789/0 conn(0x7f92ec12ce00 legacy=0x7f92ec13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:20.630 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3724828523 0 0) 0x7f92cc004bd0 con 0x7f92ec08fa70 2021-02-06T22:55:20.631 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92ec113b00 con 0x7f92ec08fa70 2021-02-06T22:55:20.631 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f92dc001cb0 con 0x7f92ec08fa70 2021-02-06T22:55:20.631 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 637333999 0 0) 0x7f92ec114040 con 0x7f92ec092bf0 2021-02-06T22:55:20.631 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92cc004bd0 con 0x7f92ec092bf0 2021-02-06T22:55:20.631 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137721690 0 0) 0x7f92ec113da0 con 0x7f92ec12ce00 2021-02-06T22:55:20.632 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ec114040 con 0x7f92ec12ce00 2021-02-06T22:55:20.632 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.622+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f92e0001c60 con 0x7f92ec092bf0 2021-02-06T22:55:20.632 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2625973879 0 0) 0x7f92ec113b00 con 0x7f92ec08fa70 2021-02-06T22:55:20.632 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.106:6789/0 conn(0x7f92ec12ce00 legacy=0x7f92ec13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.632 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.51:6789/0 conn(0x7f92ec092bf0 legacy=0x7f92ec110ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec111ed0 con 0x7f92ec08fa70 2021-02-06T22:55:20.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec114400 con 0x7f92ec08fa70 2021-02-06T22:55:20.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92f1f9c700 10 client.4589.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:20.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec12cc00 con 0x7f92ec08fa70 2021-02-06T22:55:20.633 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92f1f9c700 1 librados: init done 2021-02-06T22:55:20.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f92dc002360 con 0x7f92ec08fa70 2021-02-06T22:55:20.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f92dc002670 con 0x7f92ec08fa70 2021-02-06T22:55:20.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.623+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f92dc002890 con 0x7f92ec08fa70 2021-02-06T22:55:20.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c4004d60 con 0x7f92ec08fa70 2021-02-06T22:55:20.634 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f92dc0395c0 con 0x7f92ec08fa70 2021-02-06T22:55:20.635 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92d37fe700 10 client.4589.objecter ms_dispatch 0x7f92ec001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:20.635 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92d37fe700 3 client.4589.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:20.635 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92d37fe700 3 client.4589.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:20.635 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.624+0000 7f92d37fe700 20 client.4589.objecter dump_active .. 0 homeless 2021-02-06T22:55:20.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.626+0000 7f92d37fe700 10 client.4589.objecter ms_handle_connect 0x7f92cc030790 2021-02-06T22:55:20.636 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.628+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f92dc012280 con 0x7f92ec08fa70 2021-02-06T22:55:20.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.875+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f92c40059b0 con 0x7f92ec08fa70 2021-02-06T22:55:20.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.875+0000 7f92d37fe700 1 -- 172.21.15.51:0/1312948848 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f92dc0120a0 con 0x7f92ec08fa70 2021-02-06T22:55:20.875 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:20.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 10 librados: watch_flush enter 2021-02-06T22:55:20.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 10 librados: watch_flush exit 2021-02-06T22:55:20.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 20 client.4589.objecter shutdown clearing up homeless session... 2021-02-06T22:55:20.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 10 client.4589.objecter successfully canceled tick 2021-02-06T22:55:20.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.106:6812/33219 conn(0x7f92cc030790 legacy=0x7f92cc032c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 >> v1:172.21.15.51:6790/0 conn(0x7f92ec08fa70 legacy=0x7f92ec1103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:20.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 shutdown_connections 2021-02-06T22:55:20.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 >> 172.21.15.51:0/1312948848 conn(0x7f92ec096860 msgr2=0x7f92ec0997a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:20.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 shutdown_connections 2021-02-06T22:55:20.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 -- 172.21.15.51:0/1312948848 wait complete. 2021-02-06T22:55:20.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:20.877+0000 7f92f1f9c700 1 librados: shutdown 2021-02-06T22:55:20.887 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:23.888 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:24.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.024+0000 7fcf71184700 1 Processor -- start 2021-02-06T22:55:24.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.024+0000 7fcf71184700 1 -- start start 2021-02-06T22:55:24.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.024+0000 7fcf71184700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c061bb0 con 0x7fcf6c097560 2021-02-06T22:55:24.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.024+0000 7fcf71184700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c08f0f0 con 0x7fcf6c090f50 2021-02-06T22:55:24.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.024+0000 7fcf71184700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c08f390 con 0x7fcf6c127640 2021-02-06T22:55:24.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf6bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fcf6c097560 0x7fcf6c090840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60404/0 (socket says 172.21.15.51:60404) 2021-02-06T22:55:24.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf70983700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcf6c127640 0x7fcf6c1330b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60748/0 (socket says 172.21.15.51:60748) 2021-02-06T22:55:24.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf6bfff700 1 -- 172.21.15.51:0/2173262995 learned_addr learned my addr 172.21.15.51:0/2173262995 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:24.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf6b7fe700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c090f50 legacy=0x7fcf6c12f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2021-02-06T22:55:24.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf6b7fe700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c090f50 legacy=0x7fcf6c12f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2021-02-06T22:55:24.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.025+0000 7fcf6b7fe700 1 --1- 172.21.15.51:0/2173262995 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c090f50 0x7fcf6c12f980 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2021-02-06T22:55:24.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6bfff700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.51:6789/0 conn(0x7fcf6c097560 legacy=0x7fcf6c090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:24.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf70983700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.51:6790/0 conn(0x7fcf6c127640 legacy=0x7fcf6c1330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:24.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863146089 0 0) 0x7fcf6c061bb0 con 0x7fcf6c097560 2021-02-06T22:55:24.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf58003230 con 0x7fcf6c097560 2021-02-06T22:55:24.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305012298 0 0) 0x7fcf6c08f390 con 0x7fcf6c127640 2021-02-06T22:55:24.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c061bb0 con 0x7fcf6c127640 2021-02-06T22:55:24.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2746811134 0 0) 0x7fcf58003230 con 0x7fcf6c097560 2021-02-06T22:55:24.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.51:6790/0 conn(0x7fcf6c127640 legacy=0x7fcf6c1330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c090f50 legacy=0x7fcf6c12f980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-02-06T22:55:24.031 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c08ea60 con 0x7fcf6c097560 2021-02-06T22:55:24.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf5c001930 con 0x7fcf6c097560 2021-02-06T22:55:24.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf64001cb0 con 0x7fcf6c127640 2021-02-06T22:55:24.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcf5c001c40 con 0x7fcf6c097560 2021-02-06T22:55:24.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.027+0000 7fcf6affd700 1 -- 172.21.15.51:0/2173262995 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf5c004750 con 0x7fcf6c097560 2021-02-06T22:55:24.032 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.028+0000 7fcf71184700 1 -- 172.21.15.51:0/2173262995 >> v1:172.21.15.51:6789/0 conn(0x7fcf6c097560 legacy=0x7fcf6c090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.028+0000 7fcf71184700 1 -- 172.21.15.51:0/2173262995 shutdown_connections 2021-02-06T22:55:24.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.028+0000 7fcf71184700 1 -- 172.21.15.51:0/2173262995 >> 172.21.15.51:0/2173262995 conn(0x7fcf6c09ac60 msgr2=0x7fcf6c096c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:24.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.028+0000 7fcf71184700 1 -- 172.21.15.51:0/2173262995 shutdown_connections 2021-02-06T22:55:24.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.028+0000 7fcf71184700 1 -- 172.21.15.51:0/2173262995 wait complete. 2021-02-06T22:55:24.033 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 librados: starting msgr at 2021-02-06T22:55:24.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 librados: starting objecter 2021-02-06T22:55:24.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 Processor -- start 2021-02-06T22:55:24.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 -- start start 2021-02-06T22:55:24.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 librados: setting wanted keys 2021-02-06T22:55:24.034 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 librados: calling monclient init 2021-02-06T22:55:24.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c11f9a0 con 0x7fcf6c097560 2021-02-06T22:55:24.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c11fc40 con 0x7fcf6c127640 2021-02-06T22:55:24.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf71184700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c11fee0 con 0x7fcf6c090f50 2021-02-06T22:55:24.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf6bfff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fcf6c090f50 0x7fcf6c1233b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60752/0 (socket says 172.21.15.51:60752) 2021-02-06T22:55:24.035 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.029+0000 7fcf6bfff700 1 -- 172.21.15.51:0/515094026 learned_addr learned my addr 172.21.15.51:0/515094026 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:24.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf6b7fe700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.51:6789/0 conn(0x7fcf6c097560 legacy=0x7fcf6c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:24.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf6bfff700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.51:6790/0 conn(0x7fcf6c090f50 legacy=0x7fcf6c1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:24.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter ms_handle_connect 0x7fcf6c097560 2021-02-06T22:55:24.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:24.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter ms_handle_connect 0x7fcf6c090f50 2021-02-06T22:55:24.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:24.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter ms_handle_connect 0x7fcf6c127640 2021-02-06T22:55:24.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:24.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf70983700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c127640 legacy=0x7fcf6c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:24.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134692023 0 0) 0x7fcf6c11f9a0 con 0x7fcf6c097560 2021-02-06T22:55:24.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c004bd0 con 0x7fcf6c097560 2021-02-06T22:55:24.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999482299 0 0) 0x7fcf6c11fee0 con 0x7fcf6c090f50 2021-02-06T22:55:24.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c11f9a0 con 0x7fcf6c090f50 2021-02-06T22:55:24.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764094011 0 0) 0x7fcf6c11fc40 con 0x7fcf6c127640 2021-02-06T22:55:24.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c11fee0 con 0x7fcf6c127640 2021-02-06T22:55:24.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 514466359 0 0) 0x7fcf4c004bd0 con 0x7fcf6c097560 2021-02-06T22:55:24.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf6c11fc40 con 0x7fcf6c097560 2021-02-06T22:55:24.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf60002b50 con 0x7fcf6c097560 2021-02-06T22:55:24.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1914731798 0 0) 0x7fcf6c11f9a0 con 0x7fcf6c090f50 2021-02-06T22:55:24.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf4c004bd0 con 0x7fcf6c090f50 2021-02-06T22:55:24.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf5c0018f0 con 0x7fcf6c090f50 2021-02-06T22:55:24.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3279164507 0 0) 0x7fcf6c11fee0 con 0x7fcf6c127640 2021-02-06T22:55:24.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcf6c11f9a0 con 0x7fcf6c127640 2021-02-06T22:55:24.046 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf64001ff0 con 0x7fcf6c127640 2021-02-06T22:55:24.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.032+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2576190347 0 0) 0x7fcf6c11fc40 con 0x7fcf6c097560 2021-02-06T22:55:24.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.51:6790/0 conn(0x7fcf6c090f50 legacy=0x7fcf6c1233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.106:6789/0 conn(0x7fcf6c127640 legacy=0x7fcf6c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c123ac0 con 0x7fcf6c097560 2021-02-06T22:55:24.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c13a090 con 0x7fcf6c097560 2021-02-06T22:55:24.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf71184700 10 client.4617.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:24.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c13a500 con 0x7fcf6c097560 2021-02-06T22:55:24.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf71184700 1 librados: init done 2021-02-06T22:55:24.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fcf60001200 con 0x7fcf6c097560 2021-02-06T22:55:24.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fcf60001510 con 0x7fcf6c097560 2021-02-06T22:55:24.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fcf600016f0 con 0x7fcf6c097560 2021-02-06T22:55:24.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fcf600393e0 con 0x7fcf6c097560 2021-02-06T22:55:24.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 10 client.4617.objecter ms_dispatch 0x7fcf6c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:24.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 3 client.4617.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:24.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.033+0000 7fcf53fff700 3 client.4617.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:24.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.034+0000 7fcf53fff700 20 client.4617.objecter dump_active .. 0 homeless 2021-02-06T22:55:24.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.034+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf44004d60 con 0x7fcf6c097560 2021-02-06T22:55:24.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.036+0000 7fcf53fff700 10 client.4617.objecter ms_handle_connect 0x7fcf4c030720 2021-02-06T22:55:24.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.038+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fcf600122d0 con 0x7fcf6c097560 2021-02-06T22:55:24.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.294+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcf440059b0 con 0x7fcf6c097560 2021-02-06T22:55:24.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.294+0000 7fcf53fff700 1 -- 172.21.15.51:0/515094026 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fcf60011ec0 con 0x7fcf6c097560 2021-02-06T22:55:24.294 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:24.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.295+0000 7fcf71184700 10 librados: watch_flush enter 2021-02-06T22:55:24.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.295+0000 7fcf71184700 10 librados: watch_flush exit 2021-02-06T22:55:24.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.295+0000 7fcf71184700 20 client.4617.objecter shutdown clearing up homeless session... 2021-02-06T22:55:24.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.295+0000 7fcf71184700 10 client.4617.objecter successfully canceled tick 2021-02-06T22:55:24.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.106:6812/33219 conn(0x7fcf4c030720 legacy=0x7fcf4c032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 >> v1:172.21.15.51:6789/0 conn(0x7fcf6c097560 legacy=0x7fcf6c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:24.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 shutdown_connections 2021-02-06T22:55:24.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 >> 172.21.15.51:0/515094026 conn(0x7fcf6c09ac60 msgr2=0x7fcf6c099110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:24.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 shutdown_connections 2021-02-06T22:55:24.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 -- 172.21.15.51:0/515094026 wait complete. 2021-02-06T22:55:24.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:24.296+0000 7fcf71184700 1 librados: shutdown 2021-02-06T22:55:24.306 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:27.307 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:27.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.443+0000 7f278af5f700 1 Processor -- start 2021-02-06T22:55:27.443 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.443+0000 7f278af5f700 1 -- start start 2021-02-06T22:55:27.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278af5f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784099e60 con 0x7f2784127170 2021-02-06T22:55:27.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278af5f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2784097760 con 0x7f27840933c0 2021-02-06T22:55:27.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278af5f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840940c0 con 0x7f27841275f0 2021-02-06T22:55:27.444 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278a75e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 0x7f2784132ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60766/0 (socket says 172.21.15.51:60766) 2021-02-06T22:55:27.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278975c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 0x7f278412f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60422/0 (socket says 172.21.15.51:60422) 2021-02-06T22:55:27.445 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.444+0000 7f278a75e700 1 -- 172.21.15.51:0/244735891 learned_addr learned my addr 172.21.15.51:0/244735891 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:27.447 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.446+0000 7f278975c700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 legacy=0x7f278412f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.446+0000 7f278a75e700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 legacy=0x7f2784132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.446+0000 7f2789f5d700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.106:6789/0 conn(0x7f27840933c0 legacy=0x7f2784097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512396684 0 0) 0x7f27840940c0 con 0x7f27841275f0 2021-02-06T22:55:27.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f276c003230 con 0x7f27841275f0 2021-02-06T22:55:27.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355826262 0 0) 0x7f2784099e60 con 0x7f2784127170 2021-02-06T22:55:27.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27840940c0 con 0x7f2784127170 2021-02-06T22:55:27.449 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281772979 0 0) 0x7f2784097760 con 0x7f27840933c0 2021-02-06T22:55:27.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2784099e60 con 0x7f27840933c0 2021-02-06T22:55:27.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1587472831 0 0) 0x7f27840940c0 con 0x7f2784127170 2021-02-06T22:55:27.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 legacy=0x7f2784132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.106:6789/0 conn(0x7f27840933c0 legacy=0x7f2784097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784127a80 con 0x7f2784127170 2021-02-06T22:55:27.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2774001930 con 0x7f2784127170 2021-02-06T22:55:27.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2774001c40 con 0x7f2784127170 2021-02-06T22:55:27.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f2788f5b700 1 -- 172.21.15.51:0/244735891 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2774004690 con 0x7f2784127170 2021-02-06T22:55:27.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.447+0000 7f278af5f700 1 -- 172.21.15.51:0/244735891 >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 legacy=0x7f278412f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 -- 172.21.15.51:0/244735891 shutdown_connections 2021-02-06T22:55:27.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 -- 172.21.15.51:0/244735891 >> 172.21.15.51:0/244735891 conn(0x7f278409a1b0 msgr2=0x7f278409a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:27.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 -- 172.21.15.51:0/244735891 shutdown_connections 2021-02-06T22:55:27.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 -- 172.21.15.51:0/244735891 wait complete. 2021-02-06T22:55:27.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 librados: starting msgr at 2021-02-06T22:55:27.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 librados: starting objecter 2021-02-06T22:55:27.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 Processor -- start 2021-02-06T22:55:27.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.448+0000 7f278af5f700 1 -- start start 2021-02-06T22:55:27.453 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278af5f700 1 librados: setting wanted keys 2021-02-06T22:55:27.454 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278af5f700 1 librados: calling monclient init 2021-02-06T22:55:27.457 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278af5f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278412bd10 con 0x7f2784127170 2021-02-06T22:55:27.457 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278af5f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278412bfb0 con 0x7f27840933c0 2021-02-06T22:55:27.457 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278af5f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278412c250 con 0x7f27841275f0 2021-02-06T22:55:27.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278975c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 0x7f2784133760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60428/0 (socket says 172.21.15.51:60428) 2021-02-06T22:55:27.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278a75e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 0x7f2784141be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60772/0 (socket says 172.21.15.51:60772) 2021-02-06T22:55:27.458 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.449+0000 7f278975c700 1 -- 172.21.15.51:0/2133990853 learned_addr learned my addr 172.21.15.51:0/2133990853 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:27.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f278a75e700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 legacy=0x7f2784141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2771ffb700 10 client.?.objecter ms_handle_connect 0x7f27841275f0 2021-02-06T22:55:27.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f278975c700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 legacy=0x7f2784133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2771ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:27.460 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2771ffb700 10 client.?.objecter ms_handle_connect 0x7f2784127170 2021-02-06T22:55:27.460 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2771ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:27.460 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2789f5d700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.106:6789/0 conn(0x7f27840933c0 legacy=0x7f2784139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:27.460 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.451+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 DispatchQueue::entry inject delay of 0.002000 2021-02-06T22:55:27.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 10 client.?.objecter ms_handle_connect 0x7f27840933c0 2021-02-06T22:55:27.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:27.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436467977 0 0) 0x7f278412c250 con 0x7f27841275f0 2021-02-06T22:55:27.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2764004bd0 con 0x7f27841275f0 2021-02-06T22:55:27.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908856684 0 0) 0x7f278412bfb0 con 0x7f27840933c0 2021-02-06T22:55:27.462 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278412c250 con 0x7f27840933c0 2021-02-06T22:55:27.462 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155057379 0 0) 0x7f278412bd10 con 0x7f2784127170 2021-02-06T22:55:27.462 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.453+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f278412bfb0 con 0x7f2784127170 2021-02-06T22:55:27.463 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3783364323 0 0) 0x7f2764004bd0 con 0x7f27841275f0 2021-02-06T22:55:27.463 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f278412bd10 con 0x7f27841275f0 2021-02-06T22:55:27.463 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f277c001fe0 con 0x7f27841275f0 2021-02-06T22:55:27.463 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4073718837 0 0) 0x7f278412bfb0 con 0x7f2784127170 2021-02-06T22:55:27.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2764004bd0 con 0x7f2784127170 2021-02-06T22:55:27.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f27740018f0 con 0x7f2784127170 2021-02-06T22:55:27.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2308084669 0 0) 0x7f278412c250 con 0x7f27840933c0 2021-02-06T22:55:27.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f278412bfb0 con 0x7f27840933c0 2021-02-06T22:55:27.464 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 370242375 0 0) 0x7f278412bd10 con 0x7f27841275f0 2021-02-06T22:55:27.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.106:6789/0 conn(0x7f27840933c0 legacy=0x7f2784139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.51:6789/0 conn(0x7f2784127170 legacy=0x7f2784133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278412a0e0 con 0x7f27841275f0 2021-02-06T22:55:27.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784139fa0 con 0x7f27841275f0 2021-02-06T22:55:27.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f277c004c10 con 0x7f27841275f0 2021-02-06T22:55:27.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f277c004f20 con 0x7f27841275f0 2021-02-06T22:55:27.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f278af5f700 10 client.4601.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:27.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f278413a250 con 0x7f27841275f0 2021-02-06T22:55:27.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.454+0000 7f278af5f700 1 librados: init done 2021-02-06T22:55:27.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f277c00d7e0 con 0x7f27841275f0 2021-02-06T22:55:27.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f277c039750 con 0x7f27841275f0 2021-02-06T22:55:27.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 10 client.4601.objecter ms_dispatch 0x7f2784001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:27.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 3 client.4601.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:27.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 3 client.4601.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:27.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f2771ffb700 20 client.4601.objecter dump_active .. 0 homeless 2021-02-06T22:55:27.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.455+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784061740 con 0x7f27841275f0 2021-02-06T22:55:27.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.458+0000 7f2771ffb700 10 client.4601.objecter ms_handle_connect 0x7f2764030960 2021-02-06T22:55:27.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.459+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f277c012640 con 0x7f27841275f0 2021-02-06T22:55:27.715 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.716+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f27840581b0 con 0x7f27841275f0 2021-02-06T22:55:27.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.716+0000 7f2771ffb700 1 -- 172.21.15.51:0/2133990853 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f277c012230 con 0x7f27841275f0 2021-02-06T22:55:27.716 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:27.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 10 librados: watch_flush enter 2021-02-06T22:55:27.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 10 librados: watch_flush exit 2021-02-06T22:55:27.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 20 client.4601.objecter shutdown clearing up homeless session... 2021-02-06T22:55:27.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 10 client.4601.objecter successfully canceled tick 2021-02-06T22:55:27.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.106:6812/33219 conn(0x7f2764030960 legacy=0x7f2764032e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 >> v1:172.21.15.51:6790/0 conn(0x7f27841275f0 legacy=0x7f2784141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:27.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 shutdown_connections 2021-02-06T22:55:27.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 >> 172.21.15.51:0/2133990853 conn(0x7f278409a1b0 msgr2=0x7f278409d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:27.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 shutdown_connections 2021-02-06T22:55:27.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 -- 172.21.15.51:0/2133990853 wait complete. 2021-02-06T22:55:27.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:27.718+0000 7f278af5f700 1 librados: shutdown 2021-02-06T22:55:27.728 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:30.729 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:30.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d9776700 1 Processor -- start 2021-02-06T22:55:30.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d9776700 1 -- start start 2021-02-06T22:55:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d9776700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4095440 con 0x7f83d408fa70 2021-02-06T22:55:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d9776700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d40907b0 con 0x7f83d4092bf0 2021-02-06T22:55:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d9776700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4091010 con 0x7f83d412ce00 2021-02-06T22:55:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d2ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 0x7f83d40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60434/0 (socket says 172.21.15.51:60434) 2021-02-06T22:55:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.865+0000 7f83d37fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 0x7f83d412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60776/0 (socket says 172.21.15.51:60776) 2021-02-06T22:55:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.866+0000 7f83d2ffd700 1 -- 172.21.15.51:0/2628374086 learned_addr learned my addr 172.21.15.51:0/2628374086 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:30.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d37fe700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 legacy=0x7f83d412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d2ffd700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 legacy=0x7f83d40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449598030 0 0) 0x7f83d4091010 con 0x7f83d412ce00 2021-02-06T22:55:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b4003230 con 0x7f83d412ce00 2021-02-06T22:55:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012117768 0 0) 0x7f83d4095440 con 0x7f83d408fa70 2021-02-06T22:55:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d27fc700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.106:6789/0 conn(0x7f83d4092bf0 legacy=0x7f83d40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4091010 con 0x7f83d408fa70 2021-02-06T22:55:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3203009896 0 0) 0x7f83b4003230 con 0x7f83d412ce00 2021-02-06T22:55:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.106:6789/0 conn(0x7f83d4092bf0 legacy=0x7f83d40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 legacy=0x7f83d40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:30.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40912b0 con 0x7f83d412ce00 2021-02-06T22:55:30.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f83cc001cb0 con 0x7f83d412ce00 2021-02-06T22:55:30.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f83cc001fc0 con 0x7f83d412ce00 2021-02-06T22:55:30.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.868+0000 7f83d1ffb700 1 -- 172.21.15.51:0/2628374086 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f83cc004a10 con 0x7f83d412ce00 2021-02-06T22:55:30.871 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.869+0000 7f83d9776700 1 -- 172.21.15.51:0/2628374086 >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 legacy=0x7f83d412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:30.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.869+0000 7f83d9776700 1 -- 172.21.15.51:0/2628374086 shutdown_connections 2021-02-06T22:55:30.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.869+0000 7f83d9776700 1 -- 172.21.15.51:0/2628374086 >> 172.21.15.51:0/2628374086 conn(0x7f83d4096860 msgr2=0x7f83d4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:30.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.869+0000 7f83d9776700 1 -- 172.21.15.51:0/2628374086 shutdown_connections 2021-02-06T22:55:30.872 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.869+0000 7f83d9776700 1 -- 172.21.15.51:0/2628374086 wait complete. 2021-02-06T22:55:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 librados: starting msgr at 2021-02-06T22:55:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 librados: starting objecter 2021-02-06T22:55:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 Processor -- start 2021-02-06T22:55:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 -- start start 2021-02-06T22:55:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 librados: setting wanted keys 2021-02-06T22:55:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 librados: calling monclient init 2021-02-06T22:55:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4110770 con 0x7f83d408fa70 2021-02-06T22:55:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4112f90 con 0x7f83d4092bf0 2021-02-06T22:55:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d9776700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4113230 con 0x7f83d412ce00 2021-02-06T22:55:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d2ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 0x7f83d410f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60440/0 (socket says 172.21.15.51:60440) 2021-02-06T22:55:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d37fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 0x7f83d413eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60786/0 (socket says 172.21.15.51:60786) 2021-02-06T22:55:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.870+0000 7f83d2ffd700 1 -- 172.21.15.51:0/3366124873 learned_addr learned my addr 172.21.15.51:0/3366124873 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d37fe700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 legacy=0x7f83d413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter ms_handle_connect 0x7f83d412ce00 2021-02-06T22:55:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d2ffd700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 legacy=0x7f83d410f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter ms_handle_connect 0x7f83d408fa70 2021-02-06T22:55:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751812276 0 0) 0x7f83d4113230 con 0x7f83d412ce00 2021-02-06T22:55:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b8004bd0 con 0x7f83d412ce00 2021-02-06T22:55:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805745953 0 0) 0x7f83d4110770 con 0x7f83d408fa70 2021-02-06T22:55:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4113230 con 0x7f83d408fa70 2021-02-06T22:55:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter ms_handle_connect 0x7f83d4092bf0 2021-02-06T22:55:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d27fc700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.106:6789/0 conn(0x7f83d4092bf0 legacy=0x7f83d4110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2873813782 0 0) 0x7f83b8004bd0 con 0x7f83d412ce00 2021-02-06T22:55:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83d4110770 con 0x7f83d412ce00 2021-02-06T22:55:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f83cc001c70 con 0x7f83d412ce00 2021-02-06T22:55:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2886936171 0 0) 0x7f83d4113230 con 0x7f83d408fa70 2021-02-06T22:55:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83b8004bd0 con 0x7f83d408fa70 2021-02-06T22:55:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f83bc001c60 con 0x7f83d408fa70 2021-02-06T22:55:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224432126 0 0) 0x7f83d4112f90 con 0x7f83d4092bf0 2021-02-06T22:55:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d4113230 con 0x7f83d4092bf0 2021-02-06T22:55:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 80951756 0 0) 0x7f83d4110770 con 0x7f83d412ce00 2021-02-06T22:55:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.106:6789/0 conn(0x7f83d4092bf0 legacy=0x7f83d4110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.51:6789/0 conn(0x7f83d408fa70 legacy=0x7f83d410f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d4090bf0 con 0x7f83d412ce00 2021-02-06T22:55:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d41110e0 con 0x7f83d412ce00 2021-02-06T22:55:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d9776700 10 client.4607.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d4111f40 con 0x7f83d412ce00 2021-02-06T22:55:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83d9776700 1 librados: init done 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f83cc005000 con 0x7f83d412ce00 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.873+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f83cc005310 con 0x7f83d412ce00 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f83cc00dad0 con 0x7f83d412ce00 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f83cc039890 con 0x7f83d412ce00 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 10 client.4607.objecter ms_dispatch 0x7f83d4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:30.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 3 client.4607.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:30.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 3 client.4607.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:30.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.874+0000 7f83caffd700 20 client.4607.objecter dump_active .. 0 homeless 2021-02-06T22:55:30.886 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.875+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ac004d60 con 0x7f83d412ce00 2021-02-06T22:55:30.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.877+0000 7f83caffd700 10 client.4607.objecter ms_handle_connect 0x7f83b80306c0 2021-02-06T22:55:30.887 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:30.879+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f83cc0127e0 con 0x7f83d412ce00 2021-02-06T22:55:31.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.129+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83ac0059b0 con 0x7f83d412ce00 2021-02-06T22:55:31.129 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.130+0000 7f83caffd700 1 -- 172.21.15.51:0/3366124873 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f83cc0123d0 con 0x7f83d412ce00 2021-02-06T22:55:31.129 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:31.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 10 librados: watch_flush enter 2021-02-06T22:55:31.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 10 librados: watch_flush exit 2021-02-06T22:55:31.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 20 client.4607.objecter shutdown clearing up homeless session... 2021-02-06T22:55:31.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 10 client.4607.objecter successfully canceled tick 2021-02-06T22:55:31.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.106:6812/33219 conn(0x7f83b80306c0 legacy=0x7f83b8032b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:31.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 >> v1:172.21.15.51:6790/0 conn(0x7f83d412ce00 legacy=0x7f83d413eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:31.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 shutdown_connections 2021-02-06T22:55:31.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 >> 172.21.15.51:0/3366124873 conn(0x7f83d4096860 msgr2=0x7f83d4093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:31.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 shutdown_connections 2021-02-06T22:55:31.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.131+0000 7f83d9776700 1 -- 172.21.15.51:0/3366124873 wait complete. 2021-02-06T22:55:31.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:31.132+0000 7f83d9776700 1 librados: shutdown 2021-02-06T22:55:31.142 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:34.143 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:34.278 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.279+0000 7f77fcfe9700 1 Processor -- start 2021-02-06T22:55:34.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.279+0000 7f77fcfe9700 1 -- start start 2021-02-06T22:55:34.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.280+0000 7f77fcfe9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f8095050 con 0x7f77f8067ec0 2021-02-06T22:55:34.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.280+0000 7f77fcfe9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f8128c00 con 0x7f77f80999a0 2021-02-06T22:55:34.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.280+0000 7f77fcfe9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f8095280 con 0x7f77f8067a30 2021-02-06T22:55:34.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.280+0000 7f77f5d9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 0x7f77f812d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60792/0 (socket says 172.21.15.51:60792) 2021-02-06T22:55:34.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.280+0000 7f77f5d9b700 1 -- 172.21.15.51:0/2667894173 learned_addr learned my addr 172.21.15.51:0/2667894173 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:34.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f6d9d700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.51:6789/0 conn(0x7f77f8067ec0 legacy=0x7f77f8130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f5d9b700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 legacy=0x7f77f812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.282 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f659c700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.106:6789/0 conn(0x7f77f80999a0 legacy=0x7f77f81284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028853206 0 0) 0x7f77f8095050 con 0x7f77f8067ec0 2021-02-06T22:55:34.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77dc003230 con 0x7f77f8067ec0 2021-02-06T22:55:34.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876127506 0 0) 0x7f77f8095280 con 0x7f77f8067a30 2021-02-06T22:55:34.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8095050 con 0x7f77f8067a30 2021-02-06T22:55:34.283 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2766414450 0 0) 0x7f77dc003230 con 0x7f77f8067ec0 2021-02-06T22:55:34.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 legacy=0x7f77f812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.106:6789/0 conn(0x7f77f80999a0 legacy=0x7f77f81284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8095520 con 0x7f77f8067ec0 2021-02-06T22:55:34.284 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.282+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77f0001d00 con 0x7f77f8067ec0 2021-02-06T22:55:34.285 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f77f0002010 con 0x7f77f8067ec0 2021-02-06T22:55:34.285 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77f559a700 1 -- 172.21.15.51:0/2667894173 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77f0002420 con 0x7f77f8067ec0 2021-02-06T22:55:34.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2667894173 >> v1:172.21.15.51:6789/0 conn(0x7f77f8067ec0 legacy=0x7f77f8130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2667894173 shutdown_connections 2021-02-06T22:55:34.289 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2667894173 >> 172.21.15.51:0/2667894173 conn(0x7f77f8096860 msgr2=0x7f77f8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:34.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2667894173 shutdown_connections 2021-02-06T22:55:34.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.283+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2667894173 wait complete. 2021-02-06T22:55:34.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 librados: starting msgr at 2021-02-06T22:55:34.290 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 librados: starting objecter 2021-02-06T22:55:34.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 Processor -- start 2021-02-06T22:55:34.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 -- start start 2021-02-06T22:55:34.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 librados: setting wanted keys 2021-02-06T22:55:34.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.284+0000 7f77fcfe9700 1 librados: calling monclient init 2021-02-06T22:55:34.291 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.285+0000 7f77fcfe9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f811d9a0 con 0x7f77f80999a0 2021-02-06T22:55:34.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.285+0000 7f77fcfe9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f811dc40 con 0x7f77f8067ec0 2021-02-06T22:55:34.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.285+0000 7f77fcfe9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f811d0b0 con 0x7f77f8067a30 2021-02-06T22:55:34.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.285+0000 7f77f659c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 0x7f77f8121110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60796/0 (socket says 172.21.15.51:60796) 2021-02-06T22:55:34.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.285+0000 7f77f659c700 1 -- 172.21.15.51:0/2372223937 learned_addr learned my addr 172.21.15.51:0/2372223937 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:34.292 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77f6d9d700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.51:6789/0 conn(0x7f77f80999a0 legacy=0x7f77f813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77f659c700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 legacy=0x7f77f8121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter ms_handle_connect 0x7f77f80999a0 2021-02-06T22:55:34.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:34.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter ms_handle_connect 0x7f77f8067a30 2021-02-06T22:55:34.293 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:34.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter ms_handle_connect 0x7f77f8067ec0 2021-02-06T22:55:34.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:34.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77f5d9b700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.106:6789/0 conn(0x7f77f8067ec0 legacy=0x7f77f81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:34.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125837990 0 0) 0x7f77f811d9a0 con 0x7f77f80999a0 2021-02-06T22:55:34.294 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d4004bd0 con 0x7f77f80999a0 2021-02-06T22:55:34.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850313396 0 0) 0x7f77f811d0b0 con 0x7f77f8067a30 2021-02-06T22:55:34.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f811d9a0 con 0x7f77f8067a30 2021-02-06T22:55:34.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881328580 0 0) 0x7f77f811dc40 con 0x7f77f8067ec0 2021-02-06T22:55:34.295 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f811d0b0 con 0x7f77f8067ec0 2021-02-06T22:55:34.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2834797024 0 0) 0x7f77d4004bd0 con 0x7f77f80999a0 2021-02-06T22:55:34.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f77f811dc40 con 0x7f77f80999a0 2021-02-06T22:55:34.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77f0001cc0 con 0x7f77f80999a0 2021-02-06T22:55:34.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 120291619 0 0) 0x7f77f811d9a0 con 0x7f77f8067a30 2021-02-06T22:55:34.296 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f77d4004bd0 con 0x7f77f8067a30 2021-02-06T22:55:34.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.287+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77e8001c40 con 0x7f77f8067a30 2021-02-06T22:55:34.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4172156245 0 0) 0x7f77f811d0b0 con 0x7f77f8067ec0 2021-02-06T22:55:34.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f77f811d9a0 con 0x7f77f8067ec0 2021-02-06T22:55:34.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77ec001b00 con 0x7f77f8067ec0 2021-02-06T22:55:34.297 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2414629922 0 0) 0x7f77f811dc40 con 0x7f77f80999a0 2021-02-06T22:55:34.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.51:6790/0 conn(0x7f77f8067a30 legacy=0x7f77f8121110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.106:6789/0 conn(0x7f77f8067ec0 legacy=0x7f77f81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8121820 con 0x7f77f80999a0 2021-02-06T22:55:34.298 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f81380f0 con 0x7f77f80999a0 2021-02-06T22:55:34.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77fcfe9700 10 client.4635.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:34.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f8138560 con 0x7f77f80999a0 2021-02-06T22:55:34.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77fcfe9700 1 librados: init done 2021-02-06T22:55:34.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f77f0001910 con 0x7f77f80999a0 2021-02-06T22:55:34.299 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f77f0002ca0 con 0x7f77f80999a0 2021-02-06T22:55:34.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.288+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f77f0002e80 con 0x7f77f80999a0 2021-02-06T22:55:34.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f77f0039960 con 0x7f77f80999a0 2021-02-06T22:55:34.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77e67fc700 10 client.4635.objecter ms_dispatch 0x7f77f8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:34.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77e67fc700 3 client.4635.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:34.300 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77e67fc700 3 client.4635.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:34.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77e67fc700 20 client.4635.objecter dump_active .. 0 homeless 2021-02-06T22:55:34.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.289+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d8004d60 con 0x7f77f80999a0 2021-02-06T22:55:34.301 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.291+0000 7f77e67fc700 10 client.4635.objecter ms_handle_connect 0x7f77d40307d0 2021-02-06T22:55:34.302 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.293+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f77f0012910 con 0x7f77f80999a0 2021-02-06T22:55:34.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.542+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f77d80059b0 con 0x7f77f80999a0 2021-02-06T22:55:34.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.543+0000 7f77e67fc700 1 -- 172.21.15.51:0/2372223937 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f77f0012500 con 0x7f77f80999a0 2021-02-06T22:55:34.543 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:34.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 10 librados: watch_flush enter 2021-02-06T22:55:34.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 10 librados: watch_flush exit 2021-02-06T22:55:34.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 20 client.4635.objecter shutdown clearing up homeless session... 2021-02-06T22:55:34.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 10 client.4635.objecter successfully canceled tick 2021-02-06T22:55:34.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.106:6812/33219 conn(0x7f77d40307d0 legacy=0x7f77d4032c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 >> v1:172.21.15.51:6789/0 conn(0x7f77f80999a0 legacy=0x7f77f813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:34.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 shutdown_connections 2021-02-06T22:55:34.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 >> 172.21.15.51:0/2372223937 conn(0x7f77f8096860 msgr2=0x7f77f8126120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:34.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.544+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 shutdown_connections 2021-02-06T22:55:34.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.545+0000 7f77fcfe9700 1 -- 172.21.15.51:0/2372223937 wait complete. 2021-02-06T22:55:34.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:34.545+0000 7f77fcfe9700 1 librados: shutdown 2021-02-06T22:55:34.555 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:37.556 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:37.692 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.692+0000 7ff49f975700 1 Processor -- start 2021-02-06T22:55:37.692 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49f975700 1 -- start start 2021-02-06T22:55:37.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49f975700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980915d0 con 0x7ff4980629e0 2021-02-06T22:55:37.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49f975700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498091ac0 con 0x7ff4980999a0 2021-02-06T22:55:37.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49f975700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff498091d60 con 0x7ff4980928d0 2021-02-06T22:55:37.693 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49cf10700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff4980629e0 0x7ff498090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60464/0 (socket says 172.21.15.51:60464) 2021-02-06T22:55:37.694 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.693+0000 7ff49cf10700 1 -- 172.21.15.51:0/175729306 learned_addr learned my addr 172.21.15.51:0/175729306 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:37.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.695+0000 7ff49cf10700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.51:6789/0 conn(0x7ff4980629e0 legacy=0x7ff498090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.695+0000 7ff49df12700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.51:6790/0 conn(0x7ff4980928d0 legacy=0x7ff49812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437728892 0 0) 0x7ff4980915d0 con 0x7ff4980629e0 2021-02-06T22:55:37.696 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff480003230 con 0x7ff4980629e0 2021-02-06T22:55:37.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041537209 0 0) 0x7ff498091d60 con 0x7ff4980928d0 2021-02-06T22:55:37.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff49d711700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.106:6789/0 conn(0x7ff4980999a0 legacy=0x7ff4980907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4980915d0 con 0x7ff4980928d0 2021-02-06T22:55:37.697 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 428207057 0 0) 0x7ff4980915d0 con 0x7ff4980928d0 2021-02-06T22:55:37.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.106:6789/0 conn(0x7ff4980999a0 legacy=0x7ff4980907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.51:6789/0 conn(0x7ff4980629e0 legacy=0x7ff498090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498092000 con 0x7ff4980928d0 2021-02-06T22:55:37.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff490001c30 con 0x7ff4980928d0 2021-02-06T22:55:37.698 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff490001f40 con 0x7ff4980928d0 2021-02-06T22:55:37.699 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff487fff700 1 -- 172.21.15.51:0/175729306 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff4900023e0 con 0x7ff4980928d0 2021-02-06T22:55:37.699 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.696+0000 7ff49f975700 1 -- 172.21.15.51:0/175729306 >> v1:172.21.15.51:6790/0 conn(0x7ff4980928d0 legacy=0x7ff49812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.699 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 -- 172.21.15.51:0/175729306 shutdown_connections 2021-02-06T22:55:37.699 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 -- 172.21.15.51:0/175729306 >> 172.21.15.51:0/175729306 conn(0x7ff498096860 msgr2=0x7ff498099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:37.699 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 -- 172.21.15.51:0/175729306 shutdown_connections 2021-02-06T22:55:37.700 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 -- 172.21.15.51:0/175729306 wait complete. 2021-02-06T22:55:37.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 librados: starting msgr at 2021-02-06T22:55:37.703 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 librados: starting objecter 2021-02-06T22:55:37.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.697+0000 7ff49f975700 1 Processor -- start 2021-02-06T22:55:37.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 -- start start 2021-02-06T22:55:37.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 librados: setting wanted keys 2021-02-06T22:55:37.704 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 librados: calling monclient init 2021-02-06T22:55:37.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4980673b0 con 0x7ff4980928d0 2021-02-06T22:55:37.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4981278e0 con 0x7ff4980629e0 2021-02-06T22:55:37.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49f975700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49812fa70 con 0x7ff4980999a0 2021-02-06T22:55:37.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49cf10700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff4980928d0 0x7ff498126ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60468/0 (socket says 172.21.15.51:60468) 2021-02-06T22:55:37.705 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49df12700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff4980999a0 0x7ff4981271d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60814/0 (socket says 172.21.15.51:60814) 2021-02-06T22:55:37.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.698+0000 7ff49cf10700 1 -- 172.21.15.51:0/1207541574 learned_addr learned my addr 172.21.15.51:0/1207541574 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:37.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff49df12700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.51:6790/0 conn(0x7ff4980999a0 legacy=0x7ff4981271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff49cf10700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.51:6789/0 conn(0x7ff4980928d0 legacy=0x7ff498126ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff4857fa700 10 client.?.objecter ms_handle_connect 0x7ff4980999a0 2021-02-06T22:55:37.706 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff4857fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:37.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff4857fa700 10 client.?.objecter ms_handle_connect 0x7ff4980928d0 2021-02-06T22:55:37.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.700+0000 7ff4857fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:37.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947189754 0 0) 0x7ff49812fa70 con 0x7ff4980999a0 2021-02-06T22:55:37.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff478004bd0 con 0x7ff4980999a0 2021-02-06T22:55:37.707 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791509407 0 0) 0x7ff4980673b0 con 0x7ff4980928d0 2021-02-06T22:55:37.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49812fa70 con 0x7ff4980928d0 2021-02-06T22:55:37.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 10 client.?.objecter ms_handle_connect 0x7ff4980629e0 2021-02-06T22:55:37.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff49d711700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.106:6789/0 conn(0x7ff4980629e0 legacy=0x7ff498130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:37.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:37.708 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 587926910 0 0) 0x7ff49812fa70 con 0x7ff4980928d0 2021-02-06T22:55:37.709 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff4980673b0 con 0x7ff4980928d0 2021-02-06T22:55:37.709 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff488001c60 con 0x7ff4980928d0 2021-02-06T22:55:37.709 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 169857485 0 0) 0x7ff478004bd0 con 0x7ff4980999a0 2021-02-06T22:55:37.709 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff49812fa70 con 0x7ff4980999a0 2021-02-06T22:55:37.709 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205571690 0 0) 0x7ff4981278e0 con 0x7ff4980629e0 2021-02-06T22:55:37.710 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff478004bd0 con 0x7ff4980629e0 2021-02-06T22:55:37.710 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff490001bf0 con 0x7ff4980999a0 2021-02-06T22:55:37.710 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 528038817 0 0) 0x7ff4980673b0 con 0x7ff4980928d0 2021-02-06T22:55:37.710 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.51:6790/0 conn(0x7ff4980999a0 legacy=0x7ff4981271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.710 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.106:6789/0 conn(0x7ff4980629e0 legacy=0x7ff498130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49812fd10 con 0x7ff4980928d0 2021-02-06T22:55:37.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498130ae0 con 0x7ff4980928d0 2021-02-06T22:55:37.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff49f975700 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:37.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49813fa60 con 0x7ff4980928d0 2021-02-06T22:55:37.711 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff49f975700 1 librados: init done 2021-02-06T22:55:37.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff4880048a0 con 0x7ff4980928d0 2021-02-06T22:55:37.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.701+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff488004bb0 con 0x7ff4980928d0 2021-02-06T22:55:37.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ff488004d10 con 0x7ff4980928d0 2021-02-06T22:55:37.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ff488039530 con 0x7ff4980928d0 2021-02-06T22:55:37.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 10 client.4641.objecter ms_dispatch 0x7ff498001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:37.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 3 client.4641.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:37.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 3 client.4641.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:37.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff470004d60 con 0x7ff4980928d0 2021-02-06T22:55:37.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.702+0000 7ff4857fa700 20 client.4641.objecter dump_active .. 0 homeless 2021-02-06T22:55:37.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.705+0000 7ff4857fa700 10 client.4641.objecter ms_handle_connect 0x7ff478030820 2021-02-06T22:55:37.714 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.706+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7ff4880123c0 con 0x7ff4980928d0 2021-02-06T22:55:37.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.961+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff4700059b0 con 0x7ff4980928d0 2021-02-06T22:55:37.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.962+0000 7ff4857fa700 1 -- 172.21.15.51:0/1207541574 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7ff488011fb0 con 0x7ff4980928d0 2021-02-06T22:55:37.961 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:37.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 10 librados: watch_flush enter 2021-02-06T22:55:37.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 10 librados: watch_flush exit 2021-02-06T22:55:37.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 20 client.4641.objecter shutdown clearing up homeless session... 2021-02-06T22:55:37.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 10 client.4641.objecter successfully canceled tick 2021-02-06T22:55:37.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.106:6812/33219 conn(0x7ff478030820 legacy=0x7ff478032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 >> v1:172.21.15.51:6789/0 conn(0x7ff4980928d0 legacy=0x7ff498126ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:37.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 shutdown_connections 2021-02-06T22:55:37.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 >> 172.21.15.51:0/1207541574 conn(0x7ff498096860 msgr2=0x7ff498097160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:37.964 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 shutdown_connections 2021-02-06T22:55:37.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 -- 172.21.15.51:0/1207541574 wait complete. 2021-02-06T22:55:37.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:37.963+0000 7ff49f975700 1 librados: shutdown 2021-02-06T22:55:37.974 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:40.975 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:41.118 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.118+0000 7fddfeff3700 1 Processor -- start 2021-02-06T22:55:41.118 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfeff3700 1 -- start start 2021-02-06T22:55:41.119 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfeff3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf8095440 con 0x7fddf808fa70 2021-02-06T22:55:41.119 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfeff3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80907b0 con 0x7fddf8092bf0 2021-02-06T22:55:41.119 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfeff3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf8091010 con 0x7fddf812ce00 2021-02-06T22:55:41.120 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfcd8f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 0x7fddf80921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60478/0 (socket says 172.21.15.51:60478) 2021-02-06T22:55:41.120 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.119+0000 7fddfcd8f700 1 -- 172.21.15.51:0/3628830039 learned_addr learned my addr 172.21.15.51:0/3628830039 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:41.122 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.121+0000 7fddfd590700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.51:6790/0 conn(0x7fddf812ce00 legacy=0x7fddf812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.122 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.121+0000 7fddfcd8f700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 legacy=0x7fddf80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.122 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583508454 0 0) 0x7fddf8091010 con 0x7fddf812ce00 2021-02-06T22:55:41.123 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc003230 con 0x7fddf812ce00 2021-02-06T22:55:41.123 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374443644 0 0) 0x7fddf8095440 con 0x7fddf808fa70 2021-02-06T22:55:41.123 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf8091010 con 0x7fddf808fa70 2021-02-06T22:55:41.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf7fff700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.106:6789/0 conn(0x7fddf8092bf0 legacy=0x7fddf80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 298967546 0 0) 0x7fdddc003230 con 0x7fddf812ce00 2021-02-06T22:55:41.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.106:6789/0 conn(0x7fddf8092bf0 legacy=0x7fddf80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 legacy=0x7fddf80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.124 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80912b0 con 0x7fddf812ce00 2021-02-06T22:55:41.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddf0001d00 con 0x7fddf812ce00 2021-02-06T22:55:41.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 95895433 0 0) 0x7fddf8091010 con 0x7fddf808fa70 2021-02-06T22:55:41.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddec001860 con 0x7fddf808fa70 2021-02-06T22:55:41.125 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fddf0002010 con 0x7fddf812ce00 2021-02-06T22:55:41.126 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.122+0000 7fddf77fe700 1 -- 172.21.15.51:0/3628830039 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddf00023e0 con 0x7fddf812ce00 2021-02-06T22:55:41.126 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 -- 172.21.15.51:0/3628830039 >> v1:172.21.15.51:6790/0 conn(0x7fddf812ce00 legacy=0x7fddf812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.126 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 -- 172.21.15.51:0/3628830039 shutdown_connections 2021-02-06T22:55:41.126 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 -- 172.21.15.51:0/3628830039 >> 172.21.15.51:0/3628830039 conn(0x7fddf8096860 msgr2=0x7fddf8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:41.127 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 -- 172.21.15.51:0/3628830039 shutdown_connections 2021-02-06T22:55:41.127 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 -- 172.21.15.51:0/3628830039 wait complete. 2021-02-06T22:55:41.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 librados: starting msgr at 2021-02-06T22:55:41.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 librados: starting objecter 2021-02-06T22:55:41.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.123+0000 7fddfeff3700 1 Processor -- start 2021-02-06T22:55:41.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 -- start start 2021-02-06T22:55:41.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 librados: setting wanted keys 2021-02-06T22:55:41.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 librados: calling monclient init 2021-02-06T22:55:41.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf812a390 con 0x7fddf808fa70 2021-02-06T22:55:41.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf812a5c0 con 0x7fddf812ce00 2021-02-06T22:55:41.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfeff3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf812a860 con 0x7fddf8092bf0 2021-02-06T22:55:41.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfcd8f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 0x7fddf8125c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60482/0 (socket says 172.21.15.51:60482) 2021-02-06T22:55:41.133 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddfcd8f700 1 -- 172.21.15.51:0/3168676890 learned_addr learned my addr 172.21.15.51:0/3168676890 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:41.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.124+0000 7fddf7fff700 1 --1- 172.21.15.51:0/3168676890 >> v1:172.21.15.51:6790/0 conn(0x7fddf8092bf0 0x7fddf8126380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60826/0 (socket says 172.21.15.51:60826) 2021-02-06T22:55:41.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddfcd8f700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 legacy=0x7fddf8125c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf7fff700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.51:6790/0 conn(0x7fddf8092bf0 legacy=0x7fddf8126380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf4ff9700 10 client.?.objecter ms_handle_connect 0x7fddf808fa70 2021-02-06T22:55:41.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:41.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf4ff9700 10 client.?.objecter ms_handle_connect 0x7fddf8092bf0 2021-02-06T22:55:41.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:41.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddfd590700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.106:6789/0 conn(0x7fddf812ce00 legacy=0x7fddf813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:41.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.126+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067202939 0 0) 0x7fddf812a390 con 0x7fddf808fa70 2021-02-06T22:55:41.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddd8004bd0 con 0x7fddf808fa70 2021-02-06T22:55:41.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 10 client.?.objecter ms_handle_connect 0x7fddf812ce00 2021-02-06T22:55:41.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:41.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159743506 0 0) 0x7fddf812a860 con 0x7fddf8092bf0 2021-02-06T22:55:41.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf812a390 con 0x7fddf8092bf0 2021-02-06T22:55:41.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 236257088 0 0) 0x7fddd8004bd0 con 0x7fddf808fa70 2021-02-06T22:55:41.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fddf812a860 con 0x7fddf808fa70 2021-02-06T22:55:41.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddec001d30 con 0x7fddf808fa70 2021-02-06T22:55:41.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1028035557 0 0) 0x7fddf812a390 con 0x7fddf8092bf0 2021-02-06T22:55:41.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fddd8004bd0 con 0x7fddf8092bf0 2021-02-06T22:55:41.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968461973 0 0) 0x7fddf812a5c0 con 0x7fddf812ce00 2021-02-06T22:55:41.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf812a390 con 0x7fddf812ce00 2021-02-06T22:55:41.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fdde4001ae0 con 0x7fddf8092bf0 2021-02-06T22:55:41.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2492972806 0 0) 0x7fddf812a860 con 0x7fddf808fa70 2021-02-06T22:55:41.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.51:6790/0 conn(0x7fddf8092bf0 legacy=0x7fddf8126380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.106:6789/0 conn(0x7fddf812ce00 legacy=0x7fddf813fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.139 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8090bf0 con 0x7fddf808fa70 2021-02-06T22:55:41.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf8128750 con 0x7fddf808fa70 2021-02-06T22:55:41.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddfeff3700 10 client.4647.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:41.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf8127f60 con 0x7fddf808fa70 2021-02-06T22:55:41.140 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddfeff3700 1 librados: init done 2021-02-06T22:55:41.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fddec004860 con 0x7fddf808fa70 2021-02-06T22:55:41.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.127+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddec004b70 con 0x7fddf808fa70 2021-02-06T22:55:41.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fddec004d50 con 0x7fddf808fa70 2021-02-06T22:55:41.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fddec0394d0 con 0x7fddf808fa70 2021-02-06T22:55:41.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 10 client.4647.objecter ms_dispatch 0x7fddf8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:41.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 3 client.4647.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:41.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 3 client.4647.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:41.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddf4ff9700 20 client.4647.objecter dump_active .. 0 homeless 2021-02-06T22:55:41.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.128+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd0004d60 con 0x7fddf808fa70 2021-02-06T22:55:41.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.131+0000 7fddf4ff9700 10 client.4647.objecter ms_handle_connect 0x7fddd8030720 2021-02-06T22:55:41.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.132+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fddec0123c0 con 0x7fddf808fa70 2021-02-06T22:55:41.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.382+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fddd00059b0 con 0x7fddf808fa70 2021-02-06T22:55:41.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.383+0000 7fddf4ff9700 1 -- 172.21.15.51:0/3168676890 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fddec011fb0 con 0x7fddf808fa70 2021-02-06T22:55:41.383 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:41.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 10 librados: watch_flush enter 2021-02-06T22:55:41.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 10 librados: watch_flush exit 2021-02-06T22:55:41.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 20 client.4647.objecter shutdown clearing up homeless session... 2021-02-06T22:55:41.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 10 client.4647.objecter successfully canceled tick 2021-02-06T22:55:41.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.106:6812/33219 conn(0x7fddd8030720 legacy=0x7fddd8032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 >> v1:172.21.15.51:6789/0 conn(0x7fddf808fa70 legacy=0x7fddf8125c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:41.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 shutdown_connections 2021-02-06T22:55:41.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.384+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 >> 172.21.15.51:0/3168676890 conn(0x7fddf8096860 msgr2=0x7fddf8066c00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:41.386 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.385+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 shutdown_connections 2021-02-06T22:55:41.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.385+0000 7fddfeff3700 1 -- 172.21.15.51:0/3168676890 wait complete. 2021-02-06T22:55:41.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:41.385+0000 7fddfeff3700 1 librados: shutdown 2021-02-06T22:55:41.395 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:44.396 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:44.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f62160c4700 1 Processor -- start 2021-02-06T22:55:44.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f62160c4700 1 -- start start 2021-02-06T22:55:44.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f62160c4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100670d0 con 0x7f6210098360 2021-02-06T22:55:44.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f62160c4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6210064490 con 0x7f6210063740 2021-02-06T22:55:44.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f62160c4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6210064730 con 0x7f6210098810 2021-02-06T22:55:44.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f620effd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f6210098360 0x7f621012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60490/0 (socket says 172.21.15.51:60490) 2021-02-06T22:55:44.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f620ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6210098810 0x7f6210132fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60834/0 (socket says 172.21.15.51:60834) 2021-02-06T22:55:44.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.533+0000 7f620effd700 1 -- 172.21.15.51:0/1018369829 learned_addr learned my addr 172.21.15.51:0/1018369829 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:44.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620effd700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.51:6789/0 conn(0x7f6210098360 legacy=0x7f621012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620ffff700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.51:6790/0 conn(0x7f6210098810 legacy=0x7f6210132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929305373 0 0) 0x7f62100670d0 con 0x7f6210098360 2021-02-06T22:55:44.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620f7fe700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.106:6789/0 conn(0x7f6210063740 legacy=0x7f6210127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f0003230 con 0x7f6210098360 2021-02-06T22:55:44.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278767202 0 0) 0x7f6210064730 con 0x7f6210098810 2021-02-06T22:55:44.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62100670d0 con 0x7f6210098810 2021-02-06T22:55:44.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616280770 0 0) 0x7f6210064490 con 0x7f6210063740 2021-02-06T22:55:44.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210064730 con 0x7f6210063740 2021-02-06T22:55:44.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4048284447 0 0) 0x7f61f0003230 con 0x7f6210098360 2021-02-06T22:55:44.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.51:6790/0 conn(0x7f6210098810 legacy=0x7f6210132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.106:6789/0 conn(0x7f6210063740 legacy=0x7f6210127490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100649d0 con 0x7f6210098360 2021-02-06T22:55:44.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6200001930 con 0x7f6210098360 2021-02-06T22:55:44.539 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6200001c40 con 0x7f6210098360 2021-02-06T22:55:44.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.536+0000 7f620e7fc700 1 -- 172.21.15.51:0/1018369829 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6200004750 con 0x7f6210098360 2021-02-06T22:55:44.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.537+0000 7f62160c4700 1 -- 172.21.15.51:0/1018369829 >> v1:172.21.15.51:6789/0 conn(0x7f6210098360 legacy=0x7f621012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.537+0000 7f62160c4700 1 -- 172.21.15.51:0/1018369829 shutdown_connections 2021-02-06T22:55:44.540 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.537+0000 7f62160c4700 1 -- 172.21.15.51:0/1018369829 >> 172.21.15.51:0/1018369829 conn(0x7f621009b5e0 msgr2=0x7f621009b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:44.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.537+0000 7f62160c4700 1 -- 172.21.15.51:0/1018369829 shutdown_connections 2021-02-06T22:55:44.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.537+0000 7f62160c4700 1 -- 172.21.15.51:0/1018369829 wait complete. 2021-02-06T22:55:44.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 librados: starting msgr at 2021-02-06T22:55:44.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 librados: starting objecter 2021-02-06T22:55:44.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 Processor -- start 2021-02-06T22:55:44.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 -- start start 2021-02-06T22:55:44.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 librados: setting wanted keys 2021-02-06T22:55:44.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 librados: calling monclient init 2021-02-06T22:55:44.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6210063cb0 con 0x7f6210098810 2021-02-06T22:55:44.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6210122e10 con 0x7f6210063740 2021-02-06T22:55:44.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.538+0000 7f62160c4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62101230b0 con 0x7f6210098360 2021-02-06T22:55:44.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.539+0000 7f620effd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6210098360 0x7f621011fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60838/0 (socket says 172.21.15.51:60838) 2021-02-06T22:55:44.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.539+0000 7f620effd700 1 -- 172.21.15.51:0/3196378936 learned_addr learned my addr 172.21.15.51:0/3196378936 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:44.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f620effd700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.51:6790/0 conn(0x7f6210098360 legacy=0x7f621011fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f620ffff700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.51:6789/0 conn(0x7f6210098810 legacy=0x7f6210141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter ms_handle_connect 0x7f6210098360 2021-02-06T22:55:44.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:44.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter ms_handle_connect 0x7f6210098810 2021-02-06T22:55:44.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:44.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202275915 0 0) 0x7f62101230b0 con 0x7f6210098360 2021-02-06T22:55:44.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f4004bd0 con 0x7f6210098360 2021-02-06T22:55:44.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106351961 0 0) 0x7f6210063cb0 con 0x7f6210098810 2021-02-06T22:55:44.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62101230b0 con 0x7f6210098810 2021-02-06T22:55:44.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f620f7fe700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.106:6789/0 conn(0x7f6210063740 legacy=0x7f6210123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:44.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter ms_handle_connect 0x7f6210063740 2021-02-06T22:55:44.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:44.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1495470801 0 0) 0x7f6210122e10 con 0x7f6210063740 2021-02-06T22:55:44.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210063cb0 con 0x7f6210063740 2021-02-06T22:55:44.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1917216223 0 0) 0x7f62101230b0 con 0x7f6210098810 2021-02-06T22:55:44.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6210122e10 con 0x7f6210098810 2021-02-06T22:55:44.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6208001d10 con 0x7f6210098810 2021-02-06T22:55:44.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 320479487 0 0) 0x7f61f4004bd0 con 0x7f6210098360 2021-02-06T22:55:44.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f62101230b0 con 0x7f6210098360 2021-02-06T22:55:44.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f62000018f0 con 0x7f6210098360 2021-02-06T22:55:44.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3622676024 0 0) 0x7f6210063cb0 con 0x7f6210063740 2021-02-06T22:55:44.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61f4004bd0 con 0x7f6210063740 2021-02-06T22:55:44.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f61f8001be0 con 0x7f6210063740 2021-02-06T22:55:44.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 675060614 0 0) 0x7f62101230b0 con 0x7f6210098360 2021-02-06T22:55:44.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.106:6789/0 conn(0x7f6210063740 legacy=0x7f6210123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.552 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.51:6789/0 conn(0x7f6210098810 legacy=0x7f6210141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210122610 con 0x7f6210098360 2021-02-06T22:55:44.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.541+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210121b80 con 0x7f6210098360 2021-02-06T22:55:44.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62160c4700 10 client.4631.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:44.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f62101205a0 con 0x7f6210098360 2021-02-06T22:55:44.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62160c4700 1 librados: init done 2021-02-06T22:55:44.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6200001560 con 0x7f6210098360 2021-02-06T22:55:44.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6200004ea0 con 0x7f6210098360 2021-02-06T22:55:44.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f620000d660 con 0x7f6210098360 2021-02-06T22:55:44.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f6200039600 con 0x7f6210098360 2021-02-06T22:55:44.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 10 client.4631.objecter ms_dispatch 0x7f6210001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:44.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 3 client.4631.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:44.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.542+0000 7f62077fe700 3 client.4631.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:44.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.543+0000 7f62077fe700 20 client.4631.objecter dump_active .. 0 homeless 2021-02-06T22:55:44.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.543+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e8004d60 con 0x7f6210098360 2021-02-06T22:55:44.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.545+0000 7f62077fe700 10 client.4631.objecter ms_handle_connect 0x7f61f4030820 2021-02-06T22:55:44.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.547+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f62000124a0 con 0x7f6210098360 2021-02-06T22:55:44.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.793+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f61e80059b0 con 0x7f6210098360 2021-02-06T22:55:44.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.793+0000 7f62077fe700 1 -- 172.21.15.51:0/3196378936 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f6200012090 con 0x7f6210098360 2021-02-06T22:55:44.793 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:44.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 10 librados: watch_flush enter 2021-02-06T22:55:44.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 10 librados: watch_flush exit 2021-02-06T22:55:44.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 20 client.4631.objecter shutdown clearing up homeless session... 2021-02-06T22:55:44.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 10 client.4631.objecter successfully canceled tick 2021-02-06T22:55:44.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.106:6812/33219 conn(0x7f61f4030820 legacy=0x7f61f4032ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 >> v1:172.21.15.51:6790/0 conn(0x7f6210098360 legacy=0x7f621011fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:44.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 shutdown_connections 2021-02-06T22:55:44.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 >> 172.21.15.51:0/3196378936 conn(0x7f621009b5e0 msgr2=0x7f6210124180 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:44.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 shutdown_connections 2021-02-06T22:55:44.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 -- 172.21.15.51:0/3196378936 wait complete. 2021-02-06T22:55:44.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:44.795+0000 7f62160c4700 1 librados: shutdown 2021-02-06T22:55:44.806 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:47.807 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:47.941 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.942+0000 7ff5c0413700 1 Processor -- start 2021-02-06T22:55:47.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.942+0000 7ff5c0413700 1 -- start start 2021-02-06T22:55:47.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5c0413700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8095050 con 0x7ff5b8067ec0 2021-02-06T22:55:47.942 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5c0413700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8128c00 con 0x7ff5b8067a30 2021-02-06T22:55:47.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5c0413700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8095280 con 0x7ff5b80999a0 2021-02-06T22:55:47.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5be1af700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff5b80999a0 0x7ff5b81284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60844/0 (socket says 172.21.15.51:60844) 2021-02-06T22:55:47.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5be1af700 1 -- 172.21.15.51:0/1724916790 learned_addr learned my addr 172.21.15.51:0/1724916790 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:47.943 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.943+0000 7ff5be9b0700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067ec0 0x7ff5b8130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60502/0 (socket says 172.21.15.51:60502) 2021-02-06T22:55:47.945 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5be1af700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.51:6790/0 conn(0x7ff5b80999a0 legacy=0x7ff5b81284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5be9b0700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067ec0 legacy=0x7ff5b8130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd9ae700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.106:6789/0 conn(0x7ff5b8067a30 legacy=0x7ff5b812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563262791 0 0) 0x7ff5b8095050 con 0x7ff5b8067ec0 2021-02-06T22:55:47.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a0003230 con 0x7ff5b8067ec0 2021-02-06T22:55:47.946 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504120202 0 0) 0x7ff5b8095280 con 0x7ff5b80999a0 2021-02-06T22:55:47.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8095050 con 0x7ff5b80999a0 2021-02-06T22:55:47.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88961276 0 0) 0x7ff5b8128c00 con 0x7ff5b8067a30 2021-02-06T22:55:47.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8095280 con 0x7ff5b8067a30 2021-02-06T22:55:47.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3313681649 0 0) 0x7ff5b8095050 con 0x7ff5b80999a0 2021-02-06T22:55:47.947 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.106:6789/0 conn(0x7ff5b8067a30 legacy=0x7ff5b812d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:47.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.945+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067ec0 legacy=0x7ff5b8130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:47.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8095520 con 0x7ff5b80999a0 2021-02-06T22:55:47.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5a8001a10 con 0x7ff5b80999a0 2021-02-06T22:55:47.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5a8001c20 con 0x7ff5b80999a0 2021-02-06T22:55:47.948 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5bd1ad700 1 -- 172.21.15.51:0/1724916790 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5a8004750 con 0x7ff5b80999a0 2021-02-06T22:55:47.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5c0413700 1 -- 172.21.15.51:0/1724916790 >> v1:172.21.15.51:6790/0 conn(0x7ff5b80999a0 legacy=0x7ff5b81284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:47.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5c0413700 1 -- 172.21.15.51:0/1724916790 shutdown_connections 2021-02-06T22:55:47.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5c0413700 1 -- 172.21.15.51:0/1724916790 >> 172.21.15.51:0/1724916790 conn(0x7ff5b8096860 msgr2=0x7ff5b8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:47.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5c0413700 1 -- 172.21.15.51:0/1724916790 shutdown_connections 2021-02-06T22:55:47.949 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.946+0000 7ff5c0413700 1 -- 172.21.15.51:0/1724916790 wait complete. 2021-02-06T22:55:47.953 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 librados: starting msgr at 2021-02-06T22:55:47.953 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 librados: starting objecter 2021-02-06T22:55:47.953 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 Processor -- start 2021-02-06T22:55:47.953 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 -- start start 2021-02-06T22:55:47.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 librados: setting wanted keys 2021-02-06T22:55:47.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 librados: calling monclient init 2021-02-06T22:55:47.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8132230 con 0x7ff5b8067a30 2021-02-06T22:55:47.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b8130f50 con 0x7ff5b8067ec0 2021-02-06T22:55:47.954 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.947+0000 7ff5c0413700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b81311f0 con 0x7ff5b80999a0 2021-02-06T22:55:47.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.948+0000 7ff5be1af700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067a30 0x7ff5b80910b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60508/0 (socket says 172.21.15.51:60508) 2021-02-06T22:55:47.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.948+0000 7ff5be1af700 1 -- 172.21.15.51:0/3341299715 learned_addr learned my addr 172.21.15.51:0/3341299715 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:47.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5be1af700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067a30 legacy=0x7ff5b80910b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5be9b0700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.51:6790/0 conn(0x7ff5b80999a0 legacy=0x7ff5b8142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter ms_handle_connect 0x7ff5b8067a30 2021-02-06T22:55:47.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:47.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter ms_handle_connect 0x7ff5b80999a0 2021-02-06T22:55:47.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:47.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408110074 0 0) 0x7ff5b8132230 con 0x7ff5b8067a30 2021-02-06T22:55:47.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5bd9ae700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.106:6789/0 conn(0x7ff5b8067ec0 legacy=0x7ff5b813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:47.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff598004bd0 con 0x7ff5b8067a30 2021-02-06T22:55:47.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter ms_handle_connect 0x7ff5b8067ec0 2021-02-06T22:55:47.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:47.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863839069 0 0) 0x7ff5b81311f0 con 0x7ff5b80999a0 2021-02-06T22:55:47.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8132230 con 0x7ff5b80999a0 2021-02-06T22:55:47.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2012735559 0 0) 0x7ff598004bd0 con 0x7ff5b8067a30 2021-02-06T22:55:47.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5b81311f0 con 0x7ff5b8067a30 2021-02-06T22:55:47.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3399239093 0 0) 0x7ff5b8132230 con 0x7ff5b80999a0 2021-02-06T22:55:47.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff598004bd0 con 0x7ff5b80999a0 2021-02-06T22:55:47.958 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5a80019d0 con 0x7ff5b8067a30 2021-02-06T22:55:47.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223785296 0 0) 0x7ff5b8130f50 con 0x7ff5b8067ec0 2021-02-06T22:55:47.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5b8132230 con 0x7ff5b8067ec0 2021-02-06T22:55:47.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5b0002060 con 0x7ff5b80999a0 2021-02-06T22:55:47.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3342518175 0 0) 0x7ff5b81311f0 con 0x7ff5b8067a30 2021-02-06T22:55:47.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.51:6790/0 conn(0x7ff5b80999a0 legacy=0x7ff5b8142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:47.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.106:6789/0 conn(0x7ff5b8067ec0 legacy=0x7ff5b813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:47.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b8131490 con 0x7ff5b8067a30 2021-02-06T22:55:47.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.950+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b8092390 con 0x7ff5b8067a30 2021-02-06T22:55:47.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5c0413700 10 client.4659.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:47.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b80908a0 con 0x7ff5b8067a30 2021-02-06T22:55:47.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5c0413700 1 librados: init done 2021-02-06T22:55:47.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff5a8001580 con 0x7ff5b8067a30 2021-02-06T22:55:47.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5a8004fd0 con 0x7ff5b8067a30 2021-02-06T22:55:47.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ff5a8005170 con 0x7ff5b8067a30 2021-02-06T22:55:47.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.951+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59c004d60 con 0x7ff5b8067a30 2021-02-06T22:55:47.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.952+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ff5a8039740 con 0x7ff5b8067a30 2021-02-06T22:55:47.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.952+0000 7ff5a67fc700 10 client.4659.objecter ms_dispatch 0x7ff5b8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:47.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.952+0000 7ff5a67fc700 3 client.4659.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:47.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.952+0000 7ff5a67fc700 3 client.4659.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:47.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.952+0000 7ff5a67fc700 20 client.4659.objecter dump_active .. 0 homeless 2021-02-06T22:55:47.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.954+0000 7ff5a67fc700 10 client.4659.objecter ms_handle_connect 0x7ff598030710 2021-02-06T22:55:47.963 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:47.955+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7ff5a8012470 con 0x7ff5b8067a30 2021-02-06T22:55:48.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.202+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff59c0059b0 con 0x7ff5b8067a30 2021-02-06T22:55:48.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.202+0000 7ff5a67fc700 1 -- 172.21.15.51:0/3341299715 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7ff5a8012290 con 0x7ff5b8067a30 2021-02-06T22:55:48.202 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:48.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 10 librados: watch_flush enter 2021-02-06T22:55:48.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 10 librados: watch_flush exit 2021-02-06T22:55:48.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 20 client.4659.objecter shutdown clearing up homeless session... 2021-02-06T22:55:48.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 10 client.4659.objecter successfully canceled tick 2021-02-06T22:55:48.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.106:6812/33219 conn(0x7ff598030710 legacy=0x7ff598032bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:48.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 >> v1:172.21.15.51:6789/0 conn(0x7ff5b8067a30 legacy=0x7ff5b80910b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:48.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 shutdown_connections 2021-02-06T22:55:48.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 >> 172.21.15.51:0/3341299715 conn(0x7ff5b8096860 msgr2=0x7ff5b8097ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:48.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 shutdown_connections 2021-02-06T22:55:48.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 -- 172.21.15.51:0/3341299715 wait complete. 2021-02-06T22:55:48.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:48.204+0000 7ff5c0413700 1 librados: shutdown 2021-02-06T22:55:48.215 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:51.216 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:51.351 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.352+0000 7f9a0f59e700 1 Processor -- start 2021-02-06T22:55:51.352 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.352+0000 7f9a0f59e700 1 -- start start 2021-02-06T22:55:51.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0f59e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10098aa0 con 0x7f9a1008f960 2021-02-06T22:55:51.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0f59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100674f0 con 0x7f9a10067110 2021-02-06T22:55:51.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0f59e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10090940 con 0x7f9a1012e7f0 2021-02-06T22:55:51.353 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0dd9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f9a1008f960 0x7f9a10098390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60518/0 (socket says 172.21.15.51:60518) 2021-02-06T22:55:51.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0ed9d700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f9a1012e7f0 0x7f9a10130be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60862/0 (socket says 172.21.15.51:60862) 2021-02-06T22:55:51.354 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.353+0000 7f9a0dd9b700 1 -- 172.21.15.51:0/3611283541 learned_addr learned my addr 172.21.15.51:0/3611283541 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:51.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0ed9d700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.51:6790/0 conn(0x7f9a1012e7f0 legacy=0x7f9a10130be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0dd9b700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.51:6789/0 conn(0x7f9a1008f960 legacy=0x7f9a10098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.357 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0e59c700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.106:6789/0 conn(0x7f9a10067110 legacy=0x7f9a10128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753347272 0 0) 0x7f9a10098aa0 con 0x7f9a1008f960 2021-02-06T22:55:51.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003230 con 0x7f9a1008f960 2021-02-06T22:55:51.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516946535 0 0) 0x7f9a10090940 con 0x7f9a1012e7f0 2021-02-06T22:55:51.358 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10098aa0 con 0x7f9a1012e7f0 2021-02-06T22:55:51.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573324966 0 0) 0x7f9a100674f0 con 0x7f9a10067110 2021-02-06T22:55:51.359 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10090940 con 0x7f9a10067110 2021-02-06T22:55:51.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3010874362 0 0) 0x7f99f4003230 con 0x7f9a1008f960 2021-02-06T22:55:51.360 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.51:6790/0 conn(0x7f9a1012e7f0 legacy=0x7f9a10130be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.106:6789/0 conn(0x7f9a10067110 legacy=0x7f9a10128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10090be0 con 0x7f9a1008f960 2021-02-06T22:55:51.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.355+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a040019f0 con 0x7f9a1008f960 2021-02-06T22:55:51.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a04001ca0 con 0x7f9a1008f960 2021-02-06T22:55:51.361 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0d59a700 1 -- 172.21.15.51:0/3611283541 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a04004750 con 0x7f9a1008f960 2021-02-06T22:55:51.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3611283541 >> v1:172.21.15.51:6789/0 conn(0x7f9a1008f960 legacy=0x7f9a10098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3611283541 shutdown_connections 2021-02-06T22:55:51.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3611283541 >> 172.21.15.51:0/3611283541 conn(0x7f9a1009b560 msgr2=0x7f9a1009b970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:51.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3611283541 shutdown_connections 2021-02-06T22:55:51.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.356+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3611283541 wait complete. 2021-02-06T22:55:51.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 librados: starting msgr at 2021-02-06T22:55:51.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 librados: starting objecter 2021-02-06T22:55:51.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 Processor -- start 2021-02-06T22:55:51.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 -- start start 2021-02-06T22:55:51.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 librados: setting wanted keys 2021-02-06T22:55:51.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 librados: calling monclient init 2021-02-06T22:55:51.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1008ff00 con 0x7f9a10067110 2021-02-06T22:55:51.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10092560 con 0x7f9a1008f960 2021-02-06T22:55:51.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0f59e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a10092800 con 0x7f9a1012e7f0 2021-02-06T22:55:51.365 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.357+0000 7f9a0e59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f9a10067110 0x7f9a10125200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60522/0 (socket says 172.21.15.51:60522) 2021-02-06T22:55:51.365 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.358+0000 7f9a0e59c700 1 -- 172.21.15.51:0/3562884934 learned_addr learned my addr 172.21.15.51:0/3562884934 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:51.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0e59c700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.51:6789/0 conn(0x7f9a10067110 legacy=0x7f9a10125200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0ed9d700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.51:6790/0 conn(0x7f9a1012e7f0 legacy=0x7f9a10142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter ms_handle_connect 0x7f9a10067110 2021-02-06T22:55:51.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:51.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter ms_handle_connect 0x7f9a1012e7f0 2021-02-06T22:55:51.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:51.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820077204 0 0) 0x7f9a1008ff00 con 0x7f9a10067110 2021-02-06T22:55:51.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0dd9b700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.106:6789/0 conn(0x7f9a1008f960 legacy=0x7f9a1013f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:51.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ec004bd0 con 0x7f9a10067110 2021-02-06T22:55:51.369 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter ms_handle_connect 0x7f9a1008f960 2021-02-06T22:55:51.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:51.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806787942 0 0) 0x7f9a10092800 con 0x7f9a1012e7f0 2021-02-06T22:55:51.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a1008ff00 con 0x7f9a1012e7f0 2021-02-06T22:55:51.370 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823216090 0 0) 0x7f9a10092560 con 0x7f9a1008f960 2021-02-06T22:55:51.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a10092800 con 0x7f9a1008f960 2021-02-06T22:55:51.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1760847075 0 0) 0x7f99ec004bd0 con 0x7f9a10067110 2021-02-06T22:55:51.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a10092560 con 0x7f9a10067110 2021-02-06T22:55:51.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a00001cb0 con 0x7f9a10067110 2021-02-06T22:55:51.371 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1815408086 0 0) 0x7f9a1008ff00 con 0x7f9a1012e7f0 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f99ec004bd0 con 0x7f9a1012e7f0 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a08001f30 con 0x7f9a1012e7f0 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3746996559 0 0) 0x7f9a10092800 con 0x7f9a1008f960 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9a1008ff00 con 0x7f9a1008f960 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a04004690 con 0x7f9a1008f960 2021-02-06T22:55:51.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2277895850 0 0) 0x7f9a10092560 con 0x7f9a10067110 2021-02-06T22:55:51.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.51:6790/0 conn(0x7f9a1012e7f0 legacy=0x7f9a10142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.106:6789/0 conn(0x7f9a1008f960 legacy=0x7f9a1013f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10098020 con 0x7f9a10067110 2021-02-06T22:55:51.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100913c0 con 0x7f9a10067110 2021-02-06T22:55:51.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0f59e700 10 client.4665.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:51.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10092d80 con 0x7f9a10067110 2021-02-06T22:55:51.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.360+0000 7f9a0f59e700 1 librados: init done 2021-02-06T22:55:51.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9a00002460 con 0x7f9a10067110 2021-02-06T22:55:51.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9a00002770 con 0x7f9a10067110 2021-02-06T22:55:51.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f9a00002950 con 0x7f9a10067110 2021-02-06T22:55:51.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f9a000395f0 con 0x7f9a10067110 2021-02-06T22:55:51.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 10 client.4665.objecter ms_dispatch 0x7f9a10001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:51.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 3 client.4665.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:51.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 3 client.4665.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:51.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f0004d60 con 0x7f9a10067110 2021-02-06T22:55:51.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.361+0000 7f99fe7fc700 20 client.4665.objecter dump_active .. 0 homeless 2021-02-06T22:55:51.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.364+0000 7f99fe7fc700 10 client.4665.objecter ms_handle_connect 0x7f99ec0308d0 2021-02-06T22:55:51.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.365+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f9a000124e0 con 0x7f9a10067110 2021-02-06T22:55:51.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.612+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f99f00059b0 con 0x7f9a10067110 2021-02-06T22:55:51.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.612+0000 7f99fe7fc700 1 -- 172.21.15.51:0/3562884934 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f9a000120d0 con 0x7f9a10067110 2021-02-06T22:55:51.612 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:51.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 10 librados: watch_flush enter 2021-02-06T22:55:51.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 10 librados: watch_flush exit 2021-02-06T22:55:51.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 20 client.4665.objecter shutdown clearing up homeless session... 2021-02-06T22:55:51.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 10 client.4665.objecter successfully canceled tick 2021-02-06T22:55:51.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.106:6812/33219 conn(0x7f99ec0308d0 legacy=0x7f99ec032d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 >> v1:172.21.15.51:6789/0 conn(0x7f9a10067110 legacy=0x7f9a10125200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:51.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 shutdown_connections 2021-02-06T22:55:51.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 >> 172.21.15.51:0/3562884934 conn(0x7f9a1009b560 msgr2=0x7f9a1011be30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:51.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 shutdown_connections 2021-02-06T22:55:51.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 -- 172.21.15.51:0/3562884934 wait complete. 2021-02-06T22:55:51.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:51.614+0000 7f9a0f59e700 1 librados: shutdown 2021-02-06T22:55:51.624 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:54.625 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:54.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.759+0000 7f0a48070700 1 Processor -- start 2021-02-06T22:55:54.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a48070700 1 -- start start 2021-02-06T22:55:54.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a48070700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a40095440 con 0x7f0a4012ce00 2021-02-06T22:55:54.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a48070700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a400907b0 con 0x7f0a4008fa70 2021-02-06T22:55:54.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a48070700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a40091010 con 0x7f0a40092bf0 2021-02-06T22:55:54.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a4560b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0a40092bf0 0x7f0a400930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60872/0 (socket says 172.21.15.51:60872) 2021-02-06T22:55:54.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a4660d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0a4012ce00 0x7f0a4012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60534/0 (socket says 172.21.15.51:60534) 2021-02-06T22:55:54.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.760+0000 7f0a4560b700 1 -- 172.21.15.51:0/131084224 learned_addr learned my addr 172.21.15.51:0/131084224 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:54.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.762+0000 7f0a4660d700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.51:6789/0 conn(0x7f0a4012ce00 legacy=0x7f0a4012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.762+0000 7f0a4560b700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.51:6790/0 conn(0x7f0a40092bf0 legacy=0x7f0a400930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413853386 0 0) 0x7f0a40095440 con 0x7f0a4012ce00 2021-02-06T22:55:54.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a28003230 con 0x7f0a4012ce00 2021-02-06T22:55:54.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145896456 0 0) 0x7f0a40091010 con 0x7f0a40092bf0 2021-02-06T22:55:54.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40095440 con 0x7f0a40092bf0 2021-02-06T22:55:54.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a45e0c700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.106:6789/0 conn(0x7f0a4008fa70 legacy=0x7f0a400921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.765 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4257760121 0 0) 0x7f0a28003230 con 0x7f0a4012ce00 2021-02-06T22:55:54.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.51:6790/0 conn(0x7f0a40092bf0 legacy=0x7f0a400930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:54.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.106:6789/0 conn(0x7f0a4008fa70 legacy=0x7f0a400921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:54.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400912b0 con 0x7f0a4012ce00 2021-02-06T22:55:54.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a38001cb0 con 0x7f0a4012ce00 2021-02-06T22:55:54.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a38001fc0 con 0x7f0a4012ce00 2021-02-06T22:55:54.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.763+0000 7f0a44e0a700 1 -- 172.21.15.51:0/131084224 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a38004a10 con 0x7f0a4012ce00 2021-02-06T22:55:54.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 -- 172.21.15.51:0/131084224 >> v1:172.21.15.51:6789/0 conn(0x7f0a4012ce00 legacy=0x7f0a4012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:54.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 -- 172.21.15.51:0/131084224 shutdown_connections 2021-02-06T22:55:54.767 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 -- 172.21.15.51:0/131084224 >> 172.21.15.51:0/131084224 conn(0x7f0a40096860 msgr2=0x7f0a40099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:54.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 -- 172.21.15.51:0/131084224 shutdown_connections 2021-02-06T22:55:54.768 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 -- 172.21.15.51:0/131084224 wait complete. 2021-02-06T22:55:54.771 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 librados: starting msgr at 2021-02-06T22:55:54.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 librados: starting objecter 2021-02-06T22:55:54.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.764+0000 7f0a48070700 1 Processor -- start 2021-02-06T22:55:54.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 -- start start 2021-02-06T22:55:54.772 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 librados: setting wanted keys 2021-02-06T22:55:54.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 librados: calling monclient init 2021-02-06T22:55:54.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a40117050 con 0x7f0a40092bf0 2021-02-06T22:55:54.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a401172f0 con 0x7f0a4012ce00 2021-02-06T22:55:54.773 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a48070700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a40117590 con 0x7f0a4008fa70 2021-02-06T22:55:54.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a45e0c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0a4008fa70 0x7f0a40139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60878/0 (socket says 172.21.15.51:60878) 2021-02-06T22:55:54.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.765+0000 7f0a45e0c700 1 -- 172.21.15.51:0/3242180646 learned_addr learned my addr 172.21.15.51:0/3242180646 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:54.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a4560b700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.51:6789/0 conn(0x7f0a40092bf0 legacy=0x7f0a4013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a45e0c700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.51:6790/0 conn(0x7f0a4008fa70 legacy=0x7f0a40139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter ms_handle_connect 0x7f0a40092bf0 2021-02-06T22:55:54.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:54.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter ms_handle_connect 0x7f0a4008fa70 2021-02-06T22:55:54.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:54.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter ms_handle_connect 0x7f0a4012ce00 2021-02-06T22:55:54.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a2dffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:54.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.767+0000 7f0a4660d700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.106:6789/0 conn(0x7f0a4012ce00 legacy=0x7f0a40142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:54.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820630991 0 0) 0x7f0a40117050 con 0x7f0a40092bf0 2021-02-06T22:55:54.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20004bd0 con 0x7f0a40092bf0 2021-02-06T22:55:54.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473540641 0 0) 0x7f0a40117590 con 0x7f0a4008fa70 2021-02-06T22:55:54.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40117050 con 0x7f0a4008fa70 2021-02-06T22:55:54.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284993351 0 0) 0x7f0a401172f0 con 0x7f0a4012ce00 2021-02-06T22:55:54.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40117590 con 0x7f0a4012ce00 2021-02-06T22:55:54.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4249081541 0 0) 0x7f0a20004bd0 con 0x7f0a40092bf0 2021-02-06T22:55:54.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a401172f0 con 0x7f0a40092bf0 2021-02-06T22:55:54.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a3c001c60 con 0x7f0a40092bf0 2021-02-06T22:55:54.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 365139967 0 0) 0x7f0a40117050 con 0x7f0a4008fa70 2021-02-06T22:55:54.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a20004bd0 con 0x7f0a4008fa70 2021-02-06T22:55:54.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a30001bc0 con 0x7f0a4008fa70 2021-02-06T22:55:54.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3329670272 0 0) 0x7f0a401172f0 con 0x7f0a40092bf0 2021-02-06T22:55:54.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.51:6790/0 conn(0x7f0a4008fa70 legacy=0x7f0a40139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:54.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.106:6789/0 conn(0x7f0a4012ce00 legacy=0x7f0a40142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:54.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40110fa0 con 0x7f0a40092bf0 2021-02-06T22:55:54.779 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4013a6a0 con 0x7f0a40092bf0 2021-02-06T22:55:54.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a3c004860 con 0x7f0a40092bf0 2021-02-06T22:55:54.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a3c004b70 con 0x7f0a40092bf0 2021-02-06T22:55:54.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a48070700 10 client.4671.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:54.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4012c250 con 0x7f0a40092bf0 2021-02-06T22:55:54.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.768+0000 7f0a48070700 1 librados: init done 2021-02-06T22:55:54.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0a3c00d3b0 con 0x7f0a40092bf0 2021-02-06T22:55:54.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0a3c039460 con 0x7f0a40092bf0 2021-02-06T22:55:54.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 10 client.4671.objecter ms_dispatch 0x7f0a40001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:54.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 3 client.4671.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:54.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 3 client.4671.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:54.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a2dffb700 20 client.4671.objecter dump_active .. 0 homeless 2021-02-06T22:55:54.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.769+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a400581b0 con 0x7f0a40092bf0 2021-02-06T22:55:54.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.772+0000 7f0a2dffb700 10 client.4671.objecter ms_handle_connect 0x7f0a200304c0 2021-02-06T22:55:54.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:54.773+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0a3c012350 con 0x7f0a40092bf0 2021-02-06T22:55:55.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.021+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0a400615b0 con 0x7f0a40092bf0 2021-02-06T22:55:55.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.021+0000 7f0a2dffb700 1 -- 172.21.15.51:0/3242180646 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0a3c011f40 con 0x7f0a40092bf0 2021-02-06T22:55:55.022 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:55.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.022+0000 7f0a48070700 10 librados: watch_flush enter 2021-02-06T22:55:55.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.022+0000 7f0a48070700 10 librados: watch_flush exit 2021-02-06T22:55:55.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.022+0000 7f0a48070700 20 client.4671.objecter shutdown clearing up homeless session... 2021-02-06T22:55:55.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.022+0000 7f0a48070700 10 client.4671.objecter successfully canceled tick 2021-02-06T22:55:55.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.106:6812/33219 conn(0x7f0a200304c0 legacy=0x7f0a20032980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:55.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 >> v1:172.21.15.51:6789/0 conn(0x7f0a40092bf0 legacy=0x7f0a4013ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:55.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 shutdown_connections 2021-02-06T22:55:55.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 >> 172.21.15.51:0/3242180646 conn(0x7f0a40096860 msgr2=0x7f0a40093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:55.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 shutdown_connections 2021-02-06T22:55:55.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 -- 172.21.15.51:0/3242180646 wait complete. 2021-02-06T22:55:55.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:55.023+0000 7f0a48070700 1 librados: shutdown 2021-02-06T22:55:55.034 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:55:58.035 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:55:58.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.169+0000 7fa9d8a12700 1 Processor -- start 2021-02-06T22:55:58.170 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d8a12700 1 -- start start 2021-02-06T22:55:58.171 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d8a12700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d40915d0 con 0x7fa9d40999a0 2021-02-06T22:55:58.171 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d8a12700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4091ac0 con 0x7fa9d40928d0 2021-02-06T22:55:58.171 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d8a12700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4091d60 con 0x7fa9d40629e0 2021-02-06T22:55:58.172 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d259c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa9d40999a0 0x7fa9d40907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60544/0 (socket says 172.21.15.51:60544) 2021-02-06T22:55:58.172 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d1d9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fa9d40629e0 0x7fa9d4090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60886/0 (socket says 172.21.15.51:60886) 2021-02-06T22:55:58.172 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.170+0000 7fa9d259c700 1 -- 172.21.15.51:0/1700418258 learned_addr learned my addr 172.21.15.51:0/1700418258 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:58.173 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d1d9b700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.51:6790/0 conn(0x7fa9d40629e0 legacy=0x7fa9d4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.174 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d259c700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.51:6789/0 conn(0x7fa9d40999a0 legacy=0x7fa9d40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.174 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d2d9d700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.106:6789/0 conn(0x7fa9d40928d0 legacy=0x7fa9d412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.174 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314576700 0 0) 0x7fa9d40915d0 con 0x7fa9d40999a0 2021-02-06T22:55:58.174 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b8003230 con 0x7fa9d40999a0 2021-02-06T22:55:58.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949993876 0 0) 0x7fa9d4091d60 con 0x7fa9d40629e0 2021-02-06T22:55:58.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d40915d0 con 0x7fa9d40629e0 2021-02-06T22:55:58.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797510968 0 0) 0x7fa9d4091ac0 con 0x7fa9d40928d0 2021-02-06T22:55:58.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d4091d60 con 0x7fa9d40928d0 2021-02-06T22:55:58.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2381596277 0 0) 0x7fa9b8003230 con 0x7fa9d40999a0 2021-02-06T22:55:58.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.51:6790/0 conn(0x7fa9d40629e0 legacy=0x7fa9d4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.106:6789/0 conn(0x7fa9d40928d0 legacy=0x7fa9d412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4092000 con 0x7fa9d40999a0 2021-02-06T22:55:58.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa9c40019f0 con 0x7fa9d40999a0 2021-02-06T22:55:58.176 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa9c4001c10 con 0x7fa9d40999a0 2021-02-06T22:55:58.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.173+0000 7fa9d159a700 1 -- 172.21.15.51:0/1700418258 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa9c4004750 con 0x7fa9d40999a0 2021-02-06T22:55:58.177 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.174+0000 7fa9d8a12700 1 -- 172.21.15.51:0/1700418258 >> v1:172.21.15.51:6789/0 conn(0x7fa9d40999a0 legacy=0x7fa9d40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.180 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.174+0000 7fa9d8a12700 1 -- 172.21.15.51:0/1700418258 shutdown_connections 2021-02-06T22:55:58.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.174+0000 7fa9d8a12700 1 -- 172.21.15.51:0/1700418258 >> 172.21.15.51:0/1700418258 conn(0x7fa9d4096860 msgr2=0x7fa9d4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:58.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.174+0000 7fa9d8a12700 1 -- 172.21.15.51:0/1700418258 shutdown_connections 2021-02-06T22:55:58.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.174+0000 7fa9d8a12700 1 -- 172.21.15.51:0/1700418258 wait complete. 2021-02-06T22:55:58.181 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 librados: starting msgr at 2021-02-06T22:55:58.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 librados: starting objecter 2021-02-06T22:55:58.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 Processor -- start 2021-02-06T22:55:58.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 -- start start 2021-02-06T22:55:58.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 librados: setting wanted keys 2021-02-06T22:55:58.182 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 librados: calling monclient init 2021-02-06T22:55:58.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4067430 con 0x7fa9d40629e0 2021-02-06T22:55:58.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4130e40 con 0x7fa9d40999a0 2021-02-06T22:55:58.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d8a12700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d4095160 con 0x7fa9d40928d0 2021-02-06T22:55:58.183 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d259c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa9d40629e0 0x7fa9d4130730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60550/0 (socket says 172.21.15.51:60550) 2021-02-06T22:55:58.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.175+0000 7fa9d259c700 1 -- 172.21.15.51:0/887275578 learned_addr learned my addr 172.21.15.51:0/887275578 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:55:58.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9d1d9b700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.51:6790/0 conn(0x7fa9d40928d0 legacy=0x7fa9d413ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9d259c700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.51:6789/0 conn(0x7fa9d40629e0 legacy=0x7fa9d4130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9c27fc700 10 client.?.objecter ms_handle_connect 0x7fa9d40928d0 2021-02-06T22:55:58.184 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:58.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9c27fc700 10 client.?.objecter ms_handle_connect 0x7fa9d40629e0 2021-02-06T22:55:58.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.177+0000 7fa9c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:58.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9d2d9d700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.106:6789/0 conn(0x7fa9d40999a0 legacy=0x7fa9d4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:55:58.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110700677 0 0) 0x7fa9d4095160 con 0x7fa9d40928d0 2021-02-06T22:55:58.185 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b0004bd0 con 0x7fa9d40928d0 2021-02-06T22:55:58.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 10 client.?.objecter ms_handle_connect 0x7fa9d40999a0 2021-02-06T22:55:58.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:55:58.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242433452 0 0) 0x7fa9d4067430 con 0x7fa9d40629e0 2021-02-06T22:55:58.186 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d4095160 con 0x7fa9d40629e0 2021-02-06T22:55:58.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2845298846 0 0) 0x7fa9b0004bd0 con 0x7fa9d40928d0 2021-02-06T22:55:58.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9d4067430 con 0x7fa9d40928d0 2021-02-06T22:55:58.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa9c8001c60 con 0x7fa9d40928d0 2021-02-06T22:55:58.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827993689 0 0) 0x7fa9d4130e40 con 0x7fa9d40999a0 2021-02-06T22:55:58.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b0004bd0 con 0x7fa9d40999a0 2021-02-06T22:55:58.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1508256929 0 0) 0x7fa9d4095160 con 0x7fa9d40629e0 2021-02-06T22:55:58.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa9d4130e40 con 0x7fa9d40629e0 2021-02-06T22:55:58.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa9c40018f0 con 0x7fa9d40629e0 2021-02-06T22:55:58.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2723328375 0 0) 0x7fa9d4067430 con 0x7fa9d40928d0 2021-02-06T22:55:58.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.106:6789/0 conn(0x7fa9d40999a0 legacy=0x7fa9d4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.51:6789/0 conn(0x7fa9d40629e0 legacy=0x7fa9d4130730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d411a680 con 0x7fa9d40928d0 2021-02-06T22:55:58.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d4093f30 con 0x7fa9d40928d0 2021-02-06T22:55:58.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9d8a12700 10 client.4655.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:55:58.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d41158d0 con 0x7fa9d40928d0 2021-02-06T22:55:58.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9d8a12700 1 librados: init done 2021-02-06T22:55:58.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa9c8004860 con 0x7fa9d40928d0 2021-02-06T22:55:58.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.178+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa9c8004b70 con 0x7fa9d40928d0 2021-02-06T22:55:58.190 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fa9c8004d90 con 0x7fa9d40928d0 2021-02-06T22:55:58.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b4004d60 con 0x7fa9d40928d0 2021-02-06T22:55:58.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fa9c80394c0 con 0x7fa9d40928d0 2021-02-06T22:55:58.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 10 client.4655.objecter ms_dispatch 0x7fa9d4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:55:58.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 3 client.4655.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:55:58.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 3 client.4655.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:55:58.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.179+0000 7fa9c27fc700 20 client.4655.objecter dump_active .. 0 homeless 2021-02-06T22:55:58.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.182+0000 7fa9c27fc700 10 client.4655.objecter ms_handle_connect 0x7fa9b0030760 2021-02-06T22:55:58.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.183+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fa9c8012180 con 0x7fa9d40928d0 2021-02-06T22:55:58.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.435+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa9b40059b0 con 0x7fa9d40928d0 2021-02-06T22:55:58.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.435+0000 7fa9c27fc700 1 -- 172.21.15.51:0/887275578 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fa9c8011fa0 con 0x7fa9d40928d0 2021-02-06T22:55:58.436 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:55:58.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 10 librados: watch_flush enter 2021-02-06T22:55:58.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 10 librados: watch_flush exit 2021-02-06T22:55:58.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 20 client.4655.objecter shutdown clearing up homeless session... 2021-02-06T22:55:58.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 10 client.4655.objecter successfully canceled tick 2021-02-06T22:55:58.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.106:6812/33219 conn(0x7fa9b0030760 legacy=0x7fa9b0032c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 >> v1:172.21.15.51:6790/0 conn(0x7fa9d40928d0 legacy=0x7fa9d413ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:55:58.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 shutdown_connections 2021-02-06T22:55:58.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 >> 172.21.15.51:0/887275578 conn(0x7fa9d4096860 msgr2=0x7fa9d4066890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:55:58.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 shutdown_connections 2021-02-06T22:55:58.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 -- 172.21.15.51:0/887275578 wait complete. 2021-02-06T22:55:58.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:55:58.437+0000 7fa9d8a12700 1 librados: shutdown 2021-02-06T22:55:58.449 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:01.450 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:01.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe4049ae700 1 Processor -- start 2021-02-06T22:56:01.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe4049ae700 1 -- start start 2021-02-06T22:56:01.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe4049ae700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400095050 con 0x7fe400067ec0 2021-02-06T22:56:01.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe4049ae700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400128c00 con 0x7fe400067a30 2021-02-06T22:56:01.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe4049ae700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400095280 con 0x7fe4000999a0 2021-02-06T22:56:01.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe3fed9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 0x7fe400130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60558/0 (socket says 172.21.15.51:60558) 2021-02-06T22:56:01.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.584+0000 7fe3fe59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe4000999a0 0x7fe4001284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60900/0 (socket says 172.21.15.51:60900) 2021-02-06T22:56:01.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.585+0000 7fe3fed9d700 1 -- 172.21.15.51:0/1352200104 learned_addr learned my addr 172.21.15.51:0/1352200104 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:01.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fe59c700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.51:6790/0 conn(0x7fe4000999a0 legacy=0x7fe4001284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fed9d700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 legacy=0x7fe400130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903864399 0 0) 0x7fe400095050 con 0x7fe400067ec0 2021-02-06T22:56:01.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fdd9b700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.106:6789/0 conn(0x7fe400067a30 legacy=0x7fe40012d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e4003230 con 0x7fe400067ec0 2021-02-06T22:56:01.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012979195 0 0) 0x7fe400095280 con 0x7fe4000999a0 2021-02-06T22:56:01.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe400095050 con 0x7fe4000999a0 2021-02-06T22:56:01.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261944960 0 0) 0x7fe400128c00 con 0x7fe400067a30 2021-02-06T22:56:01.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe400095280 con 0x7fe400067a30 2021-02-06T22:56:01.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 147463759 0 0) 0x7fe3e4003230 con 0x7fe400067ec0 2021-02-06T22:56:01.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.51:6790/0 conn(0x7fe4000999a0 legacy=0x7fe4001284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.106:6789/0 conn(0x7fe400067a30 legacy=0x7fe40012d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400095520 con 0x7fe400067ec0 2021-02-06T22:56:01.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe3f8001d70 con 0x7fe400067ec0 2021-02-06T22:56:01.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe3f8002090 con 0x7fe400067ec0 2021-02-06T22:56:01.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.587+0000 7fe3fd59a700 1 -- 172.21.15.51:0/1352200104 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe3f8004ad0 con 0x7fe400067ec0 2021-02-06T22:56:01.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.588+0000 7fe4049ae700 1 -- 172.21.15.51:0/1352200104 >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 legacy=0x7fe400130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.588+0000 7fe4049ae700 1 -- 172.21.15.51:0/1352200104 shutdown_connections 2021-02-06T22:56:01.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.588+0000 7fe4049ae700 1 -- 172.21.15.51:0/1352200104 >> 172.21.15.51:0/1352200104 conn(0x7fe400096860 msgr2=0x7fe400099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:01.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.588+0000 7fe4049ae700 1 -- 172.21.15.51:0/1352200104 shutdown_connections 2021-02-06T22:56:01.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.588+0000 7fe4049ae700 1 -- 172.21.15.51:0/1352200104 wait complete. 2021-02-06T22:56:01.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 librados: starting msgr at 2021-02-06T22:56:01.596 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 librados: starting objecter 2021-02-06T22:56:01.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 Processor -- start 2021-02-06T22:56:01.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 -- start start 2021-02-06T22:56:01.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 librados: setting wanted keys 2021-02-06T22:56:01.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 librados: calling monclient init 2021-02-06T22:56:01.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40011dd90 con 0x7fe400067ec0 2021-02-06T22:56:01.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe400093230 con 0x7fe4000999a0 2021-02-06T22:56:01.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe4049ae700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40011d280 con 0x7fe400067a30 2021-02-06T22:56:01.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe3fdd9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 0x7fe40013ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60564/0 (socket says 172.21.15.51:60564) 2021-02-06T22:56:01.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe3fe59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fe400067a30 0x7fe400121260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60904/0 (socket says 172.21.15.51:60904) 2021-02-06T22:56:01.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.589+0000 7fe3fdd9b700 1 -- 172.21.15.51:0/1597441790 learned_addr learned my addr 172.21.15.51:0/1597441790 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:01.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3fdd9b700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 legacy=0x7fe40013ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter ms_handle_connect 0x7fe400067ec0 2021-02-06T22:56:01.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3fe59c700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.51:6790/0 conn(0x7fe400067a30 legacy=0x7fe400121260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:01.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter ms_handle_connect 0x7fe400067a30 2021-02-06T22:56:01.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:01.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter ms_handle_connect 0x7fe4000999a0 2021-02-06T22:56:01.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:01.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3fed9d700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.106:6789/0 conn(0x7fe4000999a0 legacy=0x7fe400140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:01.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887295961 0 0) 0x7fe40011dd90 con 0x7fe400067ec0 2021-02-06T22:56:01.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3dc004bd0 con 0x7fe400067ec0 2021-02-06T22:56:01.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806447110 0 0) 0x7fe40011d280 con 0x7fe400067a30 2021-02-06T22:56:01.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40011dd90 con 0x7fe400067a30 2021-02-06T22:56:01.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819664648 0 0) 0x7fe400093230 con 0x7fe4000999a0 2021-02-06T22:56:01.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40011d280 con 0x7fe4000999a0 2021-02-06T22:56:01.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3409182187 0 0) 0x7fe3dc004bd0 con 0x7fe400067ec0 2021-02-06T22:56:01.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe400093230 con 0x7fe400067ec0 2021-02-06T22:56:01.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe3f4001c60 con 0x7fe400067ec0 2021-02-06T22:56:01.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1656883295 0 0) 0x7fe40011dd90 con 0x7fe400067a30 2021-02-06T22:56:01.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe3dc004bd0 con 0x7fe400067a30 2021-02-06T22:56:01.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe3f0001c80 con 0x7fe400067a30 2021-02-06T22:56:01.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3563261420 0 0) 0x7fe400093230 con 0x7fe400067ec0 2021-02-06T22:56:01.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.51:6790/0 conn(0x7fe400067a30 legacy=0x7fe400121260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.106:6789/0 conn(0x7fe4000999a0 legacy=0x7fe400140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400065e60 con 0x7fe400067ec0 2021-02-06T22:56:01.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe400121970 con 0x7fe400067ec0 2021-02-06T22:56:01.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe4049ae700 10 client.4683.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:01.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe400137c80 con 0x7fe400067ec0 2021-02-06T22:56:01.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe4049ae700 1 librados: init done 2021-02-06T22:56:01.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fe3f4002350 con 0x7fe400067ec0 2021-02-06T22:56:01.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.592+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fe3f4002660 con 0x7fe400067ec0 2021-02-06T22:56:01.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fe3f4002840 con 0x7fe400067ec0 2021-02-06T22:56:01.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fe3f4039530 con 0x7fe400067ec0 2021-02-06T22:56:01.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 10 client.4683.objecter ms_dispatch 0x7fe400001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:01.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 3 client.4683.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:01.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 3 client.4683.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:01.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e0004d60 con 0x7fe400067ec0 2021-02-06T22:56:01.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.593+0000 7fe3ee7fc700 20 client.4683.objecter dump_active .. 0 homeless 2021-02-06T22:56:01.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.596+0000 7fe3ee7fc700 10 client.4683.objecter ms_handle_connect 0x7fe3dc0304d0 2021-02-06T22:56:01.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.597+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fe3f4012420 con 0x7fe400067ec0 2021-02-06T22:56:01.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.846+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe3e00059b0 con 0x7fe400067ec0 2021-02-06T22:56:01.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.846+0000 7fe3ee7fc700 1 -- 172.21.15.51:0/1597441790 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fe3f4012010 con 0x7fe400067ec0 2021-02-06T22:56:01.847 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:01.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 10 librados: watch_flush enter 2021-02-06T22:56:01.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 10 librados: watch_flush exit 2021-02-06T22:56:01.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 20 client.4683.objecter shutdown clearing up homeless session... 2021-02-06T22:56:01.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 10 client.4683.objecter successfully canceled tick 2021-02-06T22:56:01.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.106:6812/33219 conn(0x7fe3dc0304d0 legacy=0x7fe3dc032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 >> v1:172.21.15.51:6789/0 conn(0x7fe400067ec0 legacy=0x7fe40013ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:01.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 shutdown_connections 2021-02-06T22:56:01.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 >> 172.21.15.51:0/1597441790 conn(0x7fe400096860 msgr2=0x7fe400126120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:01.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 shutdown_connections 2021-02-06T22:56:01.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 -- 172.21.15.51:0/1597441790 wait complete. 2021-02-06T22:56:01.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:01.848+0000 7fe4049ae700 1 librados: shutdown 2021-02-06T22:56:01.859 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:04.861 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:04.997 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.997+0000 7f3b8b88b700 1 Processor -- start 2021-02-06T22:56:04.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.997+0000 7f3b8b88b700 1 -- start start 2021-02-06T22:56:04.998 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.997+0000 7f3b8b88b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b84095050 con 0x7f3b840999a0 2021-02-06T22:56:04.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.997+0000 7f3b8b88b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b84128c00 con 0x7f3b84067a30 2021-02-06T22:56:04.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.997+0000 7f3b8b88b700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b84095280 con 0x7f3b84067ec0 2021-02-06T22:56:04.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.998+0000 7f3b89627700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3b840999a0 0x7f3b841284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60570/0 (socket says 172.21.15.51:60570) 2021-02-06T22:56:04.999 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.998+0000 7f3b89627700 1 -- 172.21.15.51:0/94854754 learned_addr learned my addr 172.21.15.51:0/94854754 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:05.000 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:04.998+0000 7f3b89e28700 1 --1- 172.21.15.51:0/94854754 >> v1:172.21.15.51:6790/0 conn(0x7f3b84067ec0 0x7f3b84130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60912/0 (socket says 172.21.15.51:60912) 2021-02-06T22:56:05.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b89e28700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.51:6790/0 conn(0x7f3b84067ec0 legacy=0x7f3b84130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b89627700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.51:6789/0 conn(0x7f3b840999a0 legacy=0x7f3b841284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b88e26700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.106:6789/0 conn(0x7f3b84067a30 legacy=0x7f3b8412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.002 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176109619 0 0) 0x7f3b84095280 con 0x7f3b84067ec0 2021-02-06T22:56:05.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c003230 con 0x7f3b84067ec0 2021-02-06T22:56:05.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596621718 0 0) 0x7f3b84095050 con 0x7f3b840999a0 2021-02-06T22:56:05.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b84095280 con 0x7f3b840999a0 2021-02-06T22:56:05.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836102775 0 0) 0x7f3b84128c00 con 0x7f3b84067a30 2021-02-06T22:56:05.003 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.000+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b84095050 con 0x7f3b84067a30 2021-02-06T22:56:05.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 514344698 0 0) 0x7f3b6c003230 con 0x7f3b84067ec0 2021-02-06T22:56:05.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.106:6789/0 conn(0x7f3b84067a30 legacy=0x7f3b8412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.51:6789/0 conn(0x7f3b840999a0 legacy=0x7f3b841284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.004 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84095520 con 0x7f3b84067ec0 2021-02-06T22:56:05.005 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3b7c001db0 con 0x7f3b84067ec0 2021-02-06T22:56:05.005 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b7c002040 con 0x7f3b84067ec0 2021-02-06T22:56:05.005 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b73fff700 1 -- 172.21.15.51:0/94854754 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3b7c004a10 con 0x7f3b84067ec0 2021-02-06T22:56:05.005 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b8b88b700 1 -- 172.21.15.51:0/94854754 >> v1:172.21.15.51:6790/0 conn(0x7f3b84067ec0 legacy=0x7f3b84130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.005 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b8b88b700 1 -- 172.21.15.51:0/94854754 shutdown_connections 2021-02-06T22:56:05.006 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b8b88b700 1 -- 172.21.15.51:0/94854754 >> 172.21.15.51:0/94854754 conn(0x7f3b84096860 msgr2=0x7f3b84099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:05.006 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b8b88b700 1 -- 172.21.15.51:0/94854754 shutdown_connections 2021-02-06T22:56:05.006 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.001+0000 7f3b8b88b700 1 -- 172.21.15.51:0/94854754 wait complete. 2021-02-06T22:56:05.009 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 librados: starting msgr at 2021-02-06T22:56:05.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 librados: starting objecter 2021-02-06T22:56:05.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 Processor -- start 2021-02-06T22:56:05.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 -- start start 2021-02-06T22:56:05.010 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 librados: setting wanted keys 2021-02-06T22:56:05.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.002+0000 7f3b8b88b700 1 librados: calling monclient init 2021-02-06T22:56:05.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.003+0000 7f3b8b88b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b84093230 con 0x7f3b84067a30 2021-02-06T22:56:05.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.003+0000 7f3b8b88b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8411da30 con 0x7f3b840999a0 2021-02-06T22:56:05.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.003+0000 7f3b8b88b700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8411dcd0 con 0x7f3b84067ec0 2021-02-06T22:56:05.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.003+0000 7f3b89627700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3b84067a30 0x7f3b841379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60576/0 (socket says 172.21.15.51:60576) 2021-02-06T22:56:05.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.003+0000 7f3b89627700 1 -- 172.21.15.51:0/3010444366 learned_addr learned my addr 172.21.15.51:0/3010444366 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:05.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b89627700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.51:6789/0 conn(0x7f3b84067a30 legacy=0x7f3b841379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter ms_handle_connect 0x7f3b84067a30 2021-02-06T22:56:05.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:05.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter ms_handle_connect 0x7f3b84067ec0 2021-02-06T22:56:05.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:05.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b88e26700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.51:6790/0 conn(0x7f3b84067ec0 legacy=0x7f3b841211a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485238615 0 0) 0x7f3b84093230 con 0x7f3b84067a30 2021-02-06T22:56:05.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b64004bd0 con 0x7f3b84067a30 2021-02-06T22:56:05.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020457733 0 0) 0x7f3b8411dcd0 con 0x7f3b84067ec0 2021-02-06T22:56:05.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b84093230 con 0x7f3b84067ec0 2021-02-06T22:56:05.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter ms_handle_connect 0x7f3b840999a0 2021-02-06T22:56:05.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b717fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:05.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.005+0000 7f3b89e28700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.106:6789/0 conn(0x7f3b840999a0 legacy=0x7f3b8413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:05.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169441354 0 0) 0x7f3b8411da30 con 0x7f3b840999a0 2021-02-06T22:56:05.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8411dcd0 con 0x7f3b840999a0 2021-02-06T22:56:05.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1621005926 0 0) 0x7f3b64004bd0 con 0x7f3b84067a30 2021-02-06T22:56:05.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b8411da30 con 0x7f3b84067a30 2021-02-06T22:56:05.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3b74001c60 con 0x7f3b84067a30 2021-02-06T22:56:05.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3020548145 0 0) 0x7f3b84093230 con 0x7f3b84067ec0 2021-02-06T22:56:05.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3b64004bd0 con 0x7f3b84067ec0 2021-02-06T22:56:05.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3b80001c20 con 0x7f3b84067ec0 2021-02-06T22:56:05.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3457955981 0 0) 0x7f3b8411da30 con 0x7f3b84067a30 2021-02-06T22:56:05.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.51:6790/0 conn(0x7f3b84067ec0 legacy=0x7f3b841211a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.106:6789/0 conn(0x7f3b840999a0 legacy=0x7f3b8413fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8411c6b0 con 0x7f3b84067a30 2021-02-06T22:56:05.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b841380f0 con 0x7f3b84067a30 2021-02-06T22:56:05.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b8b88b700 10 client.4689.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:05.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b841218b0 con 0x7f3b84067a30 2021-02-06T22:56:05.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b8b88b700 1 librados: init done 2021-02-06T22:56:05.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3b74004920 con 0x7f3b84067a30 2021-02-06T22:56:05.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.006+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3b74004c30 con 0x7f3b84067a30 2021-02-06T22:56:05.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3b74004e10 con 0x7f3b84067a30 2021-02-06T22:56:05.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3b74039560 con 0x7f3b84067a30 2021-02-06T22:56:05.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 10 client.4689.objecter ms_dispatch 0x7f3b84001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:05.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 3 client.4689.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:05.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 3 client.4689.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:05.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b717fa700 20 client.4689.objecter dump_active .. 0 homeless 2021-02-06T22:56:05.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.007+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c004d60 con 0x7f3b84067a30 2021-02-06T22:56:05.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.009+0000 7f3b717fa700 10 client.4689.objecter ms_handle_connect 0x7f3b640304d0 2021-02-06T22:56:05.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.011+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f3b740123f0 con 0x7f3b84067a30 2021-02-06T22:56:05.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.263+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3b5c0059b0 con 0x7f3b84067a30 2021-02-06T22:56:05.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.263+0000 7f3b717fa700 1 -- 172.21.15.51:0/3010444366 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f3b74011fe0 con 0x7f3b84067a30 2021-02-06T22:56:05.264 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:05.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 10 librados: watch_flush enter 2021-02-06T22:56:05.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 10 librados: watch_flush exit 2021-02-06T22:56:05.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 20 client.4689.objecter shutdown clearing up homeless session... 2021-02-06T22:56:05.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 10 client.4689.objecter successfully canceled tick 2021-02-06T22:56:05.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.106:6812/33219 conn(0x7f3b640304d0 legacy=0x7f3b64032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 >> v1:172.21.15.51:6789/0 conn(0x7f3b84067a30 legacy=0x7f3b841379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:05.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 shutdown_connections 2021-02-06T22:56:05.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 >> 172.21.15.51:0/3010444366 conn(0x7f3b84096860 msgr2=0x7f3b84097dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:05.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 shutdown_connections 2021-02-06T22:56:05.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 -- 172.21.15.51:0/3010444366 wait complete. 2021-02-06T22:56:05.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:05.265+0000 7f3b8b88b700 1 librados: shutdown 2021-02-06T22:56:05.277 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:08.278 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:08.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.413+0000 7f6aefee2700 1 Processor -- start 2021-02-06T22:56:08.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.413+0000 7f6aefee2700 1 -- start start 2021-02-06T22:56:08.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.414+0000 7f6aefee2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8095440 con 0x7f6ae812ce00 2021-02-06T22:56:08.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.414+0000 7f6aefee2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80907b0 con 0x7f6ae8092bf0 2021-02-06T22:56:08.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.414+0000 7f6aefee2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8091010 con 0x7f6ae808fa70 2021-02-06T22:56:08.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.414+0000 7f6aee47f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f6ae812ce00 0x7f6ae812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60588/0 (socket says 172.21.15.51:60588) 2021-02-06T22:56:08.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.414+0000 7f6aee47f700 1 -- 172.21.15.51:0/481375919 learned_addr learned my addr 172.21.15.51:0/481375919 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:08.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aee47f700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.51:6789/0 conn(0x7f6ae812ce00 legacy=0x7f6ae812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aedc7e700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.51:6790/0 conn(0x7f6ae808fa70 legacy=0x7f6ae80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aed47d700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.106:6789/0 conn(0x7f6ae8092bf0 legacy=0x7f6ae80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671294523 0 0) 0x7f6ae80907b0 con 0x7f6ae8092bf0 2021-02-06T22:56:08.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad0003230 con 0x7f6ae8092bf0 2021-02-06T22:56:08.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3351402900 0 0) 0x7f6ae8095440 con 0x7f6ae812ce00 2021-02-06T22:56:08.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae80907b0 con 0x7f6ae812ce00 2021-02-06T22:56:08.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813282365 0 0) 0x7f6ae8091010 con 0x7f6ae808fa70 2021-02-06T22:56:08.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.416+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae8095440 con 0x7f6ae808fa70 2021-02-06T22:56:08.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1946592286 0 0) 0x7f6ad0003230 con 0x7f6ae8092bf0 2021-02-06T22:56:08.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.51:6790/0 conn(0x7f6ae808fa70 legacy=0x7f6ae80921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.51:6789/0 conn(0x7f6ae812ce00 legacy=0x7f6ae812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80912b0 con 0x7f6ae8092bf0 2021-02-06T22:56:08.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6ae4001980 con 0x7f6ae8092bf0 2021-02-06T22:56:08.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6ae4001c90 con 0x7f6ae8092bf0 2021-02-06T22:56:08.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aecc7c700 1 -- 172.21.15.51:0/481375919 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6ae4002060 con 0x7f6ae8092bf0 2021-02-06T22:56:08.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aefee2700 1 -- 172.21.15.51:0/481375919 >> v1:172.21.15.106:6789/0 conn(0x7f6ae8092bf0 legacy=0x7f6ae80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aefee2700 1 -- 172.21.15.51:0/481375919 shutdown_connections 2021-02-06T22:56:08.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aefee2700 1 -- 172.21.15.51:0/481375919 >> 172.21.15.51:0/481375919 conn(0x7f6ae8096860 msgr2=0x7f6ae8099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:08.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aefee2700 1 -- 172.21.15.51:0/481375919 shutdown_connections 2021-02-06T22:56:08.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.417+0000 7f6aefee2700 1 -- 172.21.15.51:0/481375919 wait complete. 2021-02-06T22:56:08.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 librados: starting msgr at 2021-02-06T22:56:08.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 librados: starting objecter 2021-02-06T22:56:08.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 Processor -- start 2021-02-06T22:56:08.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 -- start start 2021-02-06T22:56:08.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 librados: setting wanted keys 2021-02-06T22:56:08.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.418+0000 7f6aefee2700 1 librados: calling monclient init 2021-02-06T22:56:08.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.419+0000 7f6aefee2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae8123a90 con 0x7f6ae8092bf0 2021-02-06T22:56:08.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.419+0000 7f6aefee2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae813a500 con 0x7f6ae812ce00 2021-02-06T22:56:08.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.419+0000 7f6aefee2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae812ba00 con 0x7f6ae808fa70 2021-02-06T22:56:08.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.419+0000 7f6aedc7e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6ae808fa70 0x7f6ae81396e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60932/0 (socket says 172.21.15.51:60932) 2021-02-06T22:56:08.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.419+0000 7f6aedc7e700 1 -- 172.21.15.51:0/3328719985 learned_addr learned my addr 172.21.15.51:0/3328719985 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:08.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6aed47d700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.51:6789/0 conn(0x7f6ae8092bf0 legacy=0x7f6ae8139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6aedc7e700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.51:6790/0 conn(0x7f6ae808fa70 legacy=0x7f6ae81396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter ms_handle_connect 0x7f6ae8092bf0 2021-02-06T22:56:08.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:08.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter ms_handle_connect 0x7f6ae808fa70 2021-02-06T22:56:08.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:08.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049066491 0 0) 0x7f6ae8123a90 con 0x7f6ae8092bf0 2021-02-06T22:56:08.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac8004bd0 con 0x7f6ae8092bf0 2021-02-06T22:56:08.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626584949 0 0) 0x7f6ae812ba00 con 0x7f6ae808fa70 2021-02-06T22:56:08.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae8123a90 con 0x7f6ae808fa70 2021-02-06T22:56:08.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter ms_handle_connect 0x7f6ae812ce00 2021-02-06T22:56:08.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:08.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6aee47f700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.106:6789/0 conn(0x7f6ae812ce00 legacy=0x7f6ae8141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:08.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76459753 0 0) 0x7f6ae813a500 con 0x7f6ae812ce00 2021-02-06T22:56:08.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ae812ba00 con 0x7f6ae812ce00 2021-02-06T22:56:08.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1534723307 0 0) 0x7f6ae8123a90 con 0x7f6ae808fa70 2021-02-06T22:56:08.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ae813a500 con 0x7f6ae808fa70 2021-02-06T22:56:08.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.421+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3077936025 0 0) 0x7f6ac8004bd0 con 0x7f6ae8092bf0 2021-02-06T22:56:08.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ae8123a90 con 0x7f6ae8092bf0 2021-02-06T22:56:08.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6ad8001bd0 con 0x7f6ae808fa70 2021-02-06T22:56:08.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6ae4001940 con 0x7f6ae8092bf0 2021-02-06T22:56:08.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4248785261 0 0) 0x7f6ae813a500 con 0x7f6ae808fa70 2021-02-06T22:56:08.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.106:6789/0 conn(0x7f6ae812ce00 legacy=0x7f6ae8141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.51:6789/0 conn(0x7f6ae8092bf0 legacy=0x7f6ae8139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae812bca0 con 0x7f6ae808fa70 2021-02-06T22:56:08.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8090c50 con 0x7f6ae808fa70 2021-02-06T22:56:08.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6ad80021f0 con 0x7f6ae808fa70 2021-02-06T22:56:08.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6ad8002500 con 0x7f6ae808fa70 2021-02-06T22:56:08.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6aefee2700 10 client.4673.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:08.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae812c4c0 con 0x7f6ae808fa70 2021-02-06T22:56:08.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.422+0000 7f6aefee2700 1 librados: init done 2021-02-06T22:56:08.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f6ad80026a0 con 0x7f6ae808fa70 2021-02-06T22:56:08.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f6ad8039400 con 0x7f6ae808fa70 2021-02-06T22:56:08.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 10 client.4673.objecter ms_dispatch 0x7f6ae8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:08.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 3 client.4673.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:08.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 3 client.4673.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:08.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6ad5ffb700 20 client.4673.objecter dump_active .. 0 homeless 2021-02-06T22:56:08.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.423+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80581b0 con 0x7f6ae808fa70 2021-02-06T22:56:08.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.425+0000 7f6ad5ffb700 10 client.4673.objecter ms_handle_connect 0x7f6ac8030560 2021-02-06T22:56:08.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.427+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f6ad80122a0 con 0x7f6ae808fa70 2021-02-06T22:56:08.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.674+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6ae80615b0 con 0x7f6ae808fa70 2021-02-06T22:56:08.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.674+0000 7f6ad5ffb700 1 -- 172.21.15.51:0/3328719985 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f6ad8011e90 con 0x7f6ae808fa70 2021-02-06T22:56:08.675 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:08.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.675+0000 7f6aefee2700 10 librados: watch_flush enter 2021-02-06T22:56:08.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 10 librados: watch_flush exit 2021-02-06T22:56:08.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 20 client.4673.objecter shutdown clearing up homeless session... 2021-02-06T22:56:08.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 10 client.4673.objecter successfully canceled tick 2021-02-06T22:56:08.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.106:6812/33219 conn(0x7f6ac8030560 legacy=0x7f6ac8032a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 >> v1:172.21.15.51:6790/0 conn(0x7f6ae808fa70 legacy=0x7f6ae81396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:08.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 shutdown_connections 2021-02-06T22:56:08.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 >> 172.21.15.51:0/3328719985 conn(0x7f6ae8096860 msgr2=0x7f6ae8122c80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:08.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 shutdown_connections 2021-02-06T22:56:08.678 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 -- 172.21.15.51:0/3328719985 wait complete. 2021-02-06T22:56:08.679 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:08.676+0000 7f6aefee2700 1 librados: shutdown 2021-02-06T22:56:08.687 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:11.688 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:11.823 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.822+0000 7f164e91f700 1 Processor -- start 2021-02-06T22:56:11.823 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164e91f700 1 -- start start 2021-02-06T22:56:11.824 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164e91f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648095440 con 0x7f164812ce00 2021-02-06T22:56:11.824 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164e91f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16480907b0 con 0x7f1648092bf0 2021-02-06T22:56:11.824 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164e91f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648091010 con 0x7f164808fa70 2021-02-06T22:56:11.824 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164cebc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f164812ce00 0x7f164812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60604/0 (socket says 172.21.15.51:60604) 2021-02-06T22:56:11.825 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.823+0000 7f164cebc700 1 -- 172.21.15.51:0/4025546952 learned_addr learned my addr 172.21.15.51:0/4025546952 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:11.827 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f164cebc700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.51:6789/0 conn(0x7f164812ce00 legacy=0x7f164812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.827 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1647fff700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.51:6790/0 conn(0x7f164808fa70 legacy=0x7f16480921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f16477fe700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.106:6789/0 conn(0x7f1648092bf0 legacy=0x7f16480930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282857318 0 0) 0x7f1648091010 con 0x7f164808fa70 2021-02-06T22:56:11.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1634003230 con 0x7f164808fa70 2021-02-06T22:56:11.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676145690 0 0) 0x7f1648095440 con 0x7f164812ce00 2021-02-06T22:56:11.828 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648091010 con 0x7f164812ce00 2021-02-06T22:56:11.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053589796 0 0) 0x7f16480907b0 con 0x7f1648092bf0 2021-02-06T22:56:11.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648095440 con 0x7f1648092bf0 2021-02-06T22:56:11.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1595490375 0 0) 0x7f1648091010 con 0x7f164812ce00 2021-02-06T22:56:11.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.51:6790/0 conn(0x7f164808fa70 legacy=0x7f16480921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:11.829 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.106:6789/0 conn(0x7f1648092bf0 legacy=0x7f16480930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:11.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480912b0 con 0x7f164812ce00 2021-02-06T22:56:11.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1640001cb0 con 0x7f164812ce00 2021-02-06T22:56:11.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f1640001fc0 con 0x7f164812ce00 2021-02-06T22:56:11.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.826+0000 7f1646ffd700 1 -- 172.21.15.51:0/4025546952 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1640004ad0 con 0x7f164812ce00 2021-02-06T22:56:11.830 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.827+0000 7f164e91f700 1 -- 172.21.15.51:0/4025546952 >> v1:172.21.15.51:6789/0 conn(0x7f164812ce00 legacy=0x7f164812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:11.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.827+0000 7f164e91f700 1 -- 172.21.15.51:0/4025546952 shutdown_connections 2021-02-06T22:56:11.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.827+0000 7f164e91f700 1 -- 172.21.15.51:0/4025546952 >> 172.21.15.51:0/4025546952 conn(0x7f1648096860 msgr2=0x7f1648099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:11.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.827+0000 7f164e91f700 1 -- 172.21.15.51:0/4025546952 shutdown_connections 2021-02-06T22:56:11.831 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.827+0000 7f164e91f700 1 -- 172.21.15.51:0/4025546952 wait complete. 2021-02-06T22:56:11.832 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 librados: starting msgr at 2021-02-06T22:56:11.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 librados: starting objecter 2021-02-06T22:56:11.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 Processor -- start 2021-02-06T22:56:11.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 -- start start 2021-02-06T22:56:11.833 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 librados: setting wanted keys 2021-02-06T22:56:11.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 librados: calling monclient init 2021-02-06T22:56:11.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648110f60 con 0x7f164808fa70 2021-02-06T22:56:11.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648117170 con 0x7f164812ce00 2021-02-06T22:56:11.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f164e91f700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1648090bf0 con 0x7f1648092bf0 2021-02-06T22:56:11.834 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f16477fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f1648092bf0 0x7f1648110850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60950/0 (socket says 172.21.15.51:60950) 2021-02-06T22:56:11.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f1647fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f164808fa70 0x7f1648110140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60608/0 (socket says 172.21.15.51:60608) 2021-02-06T22:56:11.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.828+0000 7f16477fe700 1 -- 172.21.15.51:0/1781506399 learned_addr learned my addr 172.21.15.51:0/1781506399 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:11.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.831+0000 7f1647fff700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.51:6789/0 conn(0x7f164808fa70 legacy=0x7f1648110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.831+0000 7f16477fe700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.51:6790/0 conn(0x7f1648092bf0 legacy=0x7f1648110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.831+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 DispatchQueue::entry inject delay of 0.002000 2021-02-06T22:56:11.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.831+0000 7f164cebc700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.106:6789/0 conn(0x7f164812ce00 legacy=0x7f1648141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:11.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter ms_handle_connect 0x7f164808fa70 2021-02-06T22:56:11.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:11.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter ms_handle_connect 0x7f1648092bf0 2021-02-06T22:56:11.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:11.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter ms_handle_connect 0x7f164812ce00 2021-02-06T22:56:11.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:11.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551406833 0 0) 0x7f1648110f60 con 0x7f164808fa70 2021-02-06T22:56:11.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1628004bd0 con 0x7f164808fa70 2021-02-06T22:56:11.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084358526 0 0) 0x7f1648090bf0 con 0x7f1648092bf0 2021-02-06T22:56:11.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648110f60 con 0x7f1648092bf0 2021-02-06T22:56:11.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593970327 0 0) 0x7f1648117170 con 0x7f164812ce00 2021-02-06T22:56:11.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1648090bf0 con 0x7f164812ce00 2021-02-06T22:56:11.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3939281845 0 0) 0x7f1628004bd0 con 0x7f164808fa70 2021-02-06T22:56:11.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1648117170 con 0x7f164808fa70 2021-02-06T22:56:11.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f163c001cb0 con 0x7f164808fa70 2021-02-06T22:56:11.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2676569468 0 0) 0x7f1648110f60 con 0x7f1648092bf0 2021-02-06T22:56:11.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1628004bd0 con 0x7f1648092bf0 2021-02-06T22:56:11.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16380018e0 con 0x7f1648092bf0 2021-02-06T22:56:11.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3164005851 0 0) 0x7f1648090bf0 con 0x7f164812ce00 2021-02-06T22:56:11.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1648110f60 con 0x7f164812ce00 2021-02-06T22:56:11.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1640001c70 con 0x7f164812ce00 2021-02-06T22:56:11.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3066857577 0 0) 0x7f1648117170 con 0x7f164808fa70 2021-02-06T22:56:11.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.51:6790/0 conn(0x7f1648092bf0 legacy=0x7f1648110850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:11.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.106:6789/0 conn(0x7f164812ce00 legacy=0x7f1648141d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:11.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164812fe90 con 0x7f164808fa70 2021-02-06T22:56:11.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.833+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164812cab0 con 0x7f164808fa70 2021-02-06T22:56:11.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f164e91f700 10 client.4701.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:11.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f16481118a0 con 0x7f164808fa70 2021-02-06T22:56:11.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f164e91f700 1 librados: init done 2021-02-06T22:56:11.844 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f163c002330 con 0x7f164808fa70 2021-02-06T22:56:11.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f163c002640 con 0x7f164808fa70 2021-02-06T22:56:11.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f163c002820 con 0x7f164808fa70 2021-02-06T22:56:11.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.834+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1620004d60 con 0x7f164808fa70 2021-02-06T22:56:11.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.835+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f163c039500 con 0x7f164808fa70 2021-02-06T22:56:11.845 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.835+0000 7f162ffff700 10 client.4701.objecter ms_dispatch 0x7f1648001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:11.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.835+0000 7f162ffff700 3 client.4701.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:11.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.835+0000 7f162ffff700 3 client.4701.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:11.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.835+0000 7f162ffff700 20 client.4701.objecter dump_active .. 0 homeless 2021-02-06T22:56:11.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.837+0000 7f162ffff700 10 client.4701.objecter ms_handle_connect 0x7f1628030870 2021-02-06T22:56:11.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:11.839+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f163c0121c0 con 0x7f164808fa70 2021-02-06T22:56:12.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.088+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16200059b0 con 0x7f164808fa70 2021-02-06T22:56:12.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.088+0000 7f162ffff700 1 -- 172.21.15.51:0/1781506399 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f163c011fe0 con 0x7f164808fa70 2021-02-06T22:56:12.089 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:12.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 10 librados: watch_flush enter 2021-02-06T22:56:12.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 10 librados: watch_flush exit 2021-02-06T22:56:12.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 20 client.4701.objecter shutdown clearing up homeless session... 2021-02-06T22:56:12.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 10 client.4701.objecter successfully canceled tick 2021-02-06T22:56:12.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.106:6812/33219 conn(0x7f1628030870 legacy=0x7f1628032d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:12.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 >> v1:172.21.15.51:6789/0 conn(0x7f164808fa70 legacy=0x7f1648110140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:12.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 shutdown_connections 2021-02-06T22:56:12.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 >> 172.21.15.51:0/1781506399 conn(0x7f1648096860 msgr2=0x7f1648099800 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:12.092 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 shutdown_connections 2021-02-06T22:56:12.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 -- 172.21.15.51:0/1781506399 wait complete. 2021-02-06T22:56:12.093 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:12.090+0000 7f164e91f700 1 librados: shutdown 2021-02-06T22:56:12.101 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:15.103 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:15.239 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.239+0000 7f9c3244b700 1 Processor -- start 2021-02-06T22:56:15.240 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.239+0000 7f9c3244b700 1 -- start start 2021-02-06T22:56:15.240 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c3244b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c0998a0 con 0x7f9c2c097200 2021-02-06T22:56:15.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c3244b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c099b10 con 0x7f9c2c0976b0 2021-02-06T22:56:15.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c2bfff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f9c2c093e80 0x7f9c2c1278b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60960/0 (socket says 172.21.15.51:60960) 2021-02-06T22:56:15.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c2b7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f9c2c097200 0x7f9c2c12fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60620/0 (socket says 172.21.15.51:60620) 2021-02-06T22:56:15.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c2bfff700 1 -- 172.21.15.51:0/208519071 learned_addr learned my addr 172.21.15.51:0/208519071 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:15.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c099db0 con 0x7f9c2c093e80 2021-02-06T22:56:15.242 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.240+0000 7f9c309e8700 1 --1- 172.21.15.51:0/208519071 >> v1:172.21.15.106:6789/0 conn(0x7f9c2c0976b0 0x7f9c2c1331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.51:59034/0 (socket says 172.21.15.51:59034) 2021-02-06T22:56:15.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.242+0000 7f9c2b7fe700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.51:6789/0 conn(0x7f9c2c097200 legacy=0x7f9c2c12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.242+0000 7f9c309e8700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.106:6789/0 conn(0x7f9c2c0976b0 legacy=0x7f9c2c1331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.242+0000 7f9c2bfff700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.51:6790/0 conn(0x7f9c2c093e80 legacy=0x7f9c2c1278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936081052 0 0) 0x7f9c2c0998a0 con 0x7f9c2c097200 2021-02-06T22:56:15.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c18003230 con 0x7f9c2c097200 2021-02-06T22:56:15.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261488246 0 0) 0x7f9c2c099b10 con 0x7f9c2c0976b0 2021-02-06T22:56:15.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c0998a0 con 0x7f9c2c0976b0 2021-02-06T22:56:15.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045654293 0 0) 0x7f9c2c099db0 con 0x7f9c2c093e80 2021-02-06T22:56:15.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c099b10 con 0x7f9c2c093e80 2021-02-06T22:56:15.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 886131986 0 0) 0x7f9c18003230 con 0x7f9c2c097200 2021-02-06T22:56:15.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.51:6790/0 conn(0x7f9c2c093e80 legacy=0x7f9c2c1278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.106:6789/0 conn(0x7f9c2c0976b0 legacy=0x7f9c2c1331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c127480 con 0x7f9c2c097200 2021-02-06T22:56:15.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9c20001930 con 0x7f9c2c097200 2021-02-06T22:56:15.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9c20001c40 con 0x7f9c2c097200 2021-02-06T22:56:15.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.243+0000 7f9c2affd700 1 -- 172.21.15.51:0/208519071 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9c20004690 con 0x7f9c2c097200 2021-02-06T22:56:15.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 >> v1:172.21.15.51:6789/0 conn(0x7f9c2c097200 legacy=0x7f9c2c12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 shutdown_connections 2021-02-06T22:56:15.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 >> 172.21.15.51:0/208519071 conn(0x7f9c2c09ae00 msgr2=0x7f9c2c09d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:15.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 shutdown_connections 2021-02-06T22:56:15.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 -- 172.21.15.51:0/208519071 wait complete. 2021-02-06T22:56:15.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 librados: starting msgr at 2021-02-06T22:56:15.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.244+0000 7f9c3244b700 1 librados: starting objecter 2021-02-06T22:56:15.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 Processor -- start 2021-02-06T22:56:15.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 -- start start 2021-02-06T22:56:15.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 librados: setting wanted keys 2021-02-06T22:56:15.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 librados: calling monclient init 2021-02-06T22:56:15.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c13a8e0 con 0x7f9c2c093e80 2021-02-06T22:56:15.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c12cff0 con 0x7f9c2c097200 2021-02-06T22:56:15.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c3244b700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c12d290 con 0x7f9c2c0976b0 2021-02-06T22:56:15.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c2bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f9c2c093e80 0x7f9c2c133790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60624/0 (socket says 172.21.15.51:60624) 2021-02-06T22:56:15.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.245+0000 7f9c2bfff700 1 -- 172.21.15.51:0/2252146424 learned_addr learned my addr 172.21.15.51:0/2252146424 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:15.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c2bfff700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.51:6789/0 conn(0x7f9c2c093e80 legacy=0x7f9c2c133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c13fff700 10 client.?.objecter ms_handle_connect 0x7f9c2c093e80 2021-02-06T22:56:15.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c309e8700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.51:6790/0 conn(0x7f9c2c0976b0 legacy=0x7f9c2c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c13fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:15.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c13fff700 10 client.?.objecter ms_handle_connect 0x7f9c2c0976b0 2021-02-06T22:56:15.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.247+0000 7f9c13fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:15.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2791901691 0 0) 0x7f9c2c13a8e0 con 0x7f9c2c093e80 2021-02-06T22:56:15.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c0c004bd0 con 0x7f9c2c093e80 2021-02-06T22:56:15.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2992350604 0 0) 0x7f9c2c12d290 con 0x7f9c2c0976b0 2021-02-06T22:56:15.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c13a8e0 con 0x7f9c2c0976b0 2021-02-06T22:56:15.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c2b7fe700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.106:6789/0 conn(0x7f9c2c097200 legacy=0x7f9c2c13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:15.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 10 client.?.objecter ms_handle_connect 0x7f9c2c097200 2021-02-06T22:56:15.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:15.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230863342 0 0) 0x7f9c2c12cff0 con 0x7f9c2c097200 2021-02-06T22:56:15.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c2c12d290 con 0x7f9c2c097200 2021-02-06T22:56:15.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 848603560 0 0) 0x7f9c0c004bd0 con 0x7f9c2c093e80 2021-02-06T22:56:15.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c2c12cff0 con 0x7f9c2c093e80 2021-02-06T22:56:15.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9c1c001c00 con 0x7f9c2c093e80 2021-02-06T22:56:15.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2705785815 0 0) 0x7f9c2c13a8e0 con 0x7f9c2c0976b0 2021-02-06T22:56:15.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9c0c004bd0 con 0x7f9c2c0976b0 2021-02-06T22:56:15.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9c24002030 con 0x7f9c2c0976b0 2021-02-06T22:56:15.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3484803097 0 0) 0x7f9c2c12cff0 con 0x7f9c2c093e80 2021-02-06T22:56:15.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.51:6790/0 conn(0x7f9c2c0976b0 legacy=0x7f9c2c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.106:6789/0 conn(0x7f9c2c097200 legacy=0x7f9c2c13ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c12bc00 con 0x7f9c2c093e80 2021-02-06T22:56:15.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c133ea0 con 0x7f9c2c093e80 2021-02-06T22:56:15.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c3244b700 10 client.4707.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:15.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c134f00 con 0x7f9c2c093e80 2021-02-06T22:56:15.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c3244b700 1 librados: init done 2021-02-06T22:56:15.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9c1c0048a0 con 0x7f9c2c093e80 2021-02-06T22:56:15.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.248+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9c1c004bb0 con 0x7f9c2c093e80 2021-02-06T22:56:15.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f9c1c004d90 con 0x7f9c2c093e80 2021-02-06T22:56:15.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f9c1c039570 con 0x7f9c2c093e80 2021-02-06T22:56:15.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 10 client.4707.objecter ms_dispatch 0x7f9c2c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:15.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 3 client.4707.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:15.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 3 client.4707.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:15.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c13fff700 20 client.4707.objecter dump_active .. 0 homeless 2021-02-06T22:56:15.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.249+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c04004d60 con 0x7f9c2c093e80 2021-02-06T22:56:15.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.252+0000 7f9c13fff700 10 client.4707.objecter ms_handle_connect 0x7f9c0c030430 2021-02-06T22:56:15.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.253+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f9c1c012460 con 0x7f9c2c093e80 2021-02-06T22:56:15.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.501+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9c040059b0 con 0x7f9c2c093e80 2021-02-06T22:56:15.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.501+0000 7f9c13fff700 1 -- 172.21.15.51:0/2252146424 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f9c1c012050 con 0x7f9c2c093e80 2021-02-06T22:56:15.502 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:15.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 10 librados: watch_flush enter 2021-02-06T22:56:15.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 10 librados: watch_flush exit 2021-02-06T22:56:15.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 20 client.4707.objecter shutdown clearing up homeless session... 2021-02-06T22:56:15.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 10 client.4707.objecter successfully canceled tick 2021-02-06T22:56:15.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.106:6812/33219 conn(0x7f9c0c030430 legacy=0x7f9c0c0328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 >> v1:172.21.15.51:6789/0 conn(0x7f9c2c093e80 legacy=0x7f9c2c133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:15.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 shutdown_connections 2021-02-06T22:56:15.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.502+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 >> 172.21.15.51:0/2252146424 conn(0x7f9c2c09ae00 msgr2=0x7f9c2c096440 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:15.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.503+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 shutdown_connections 2021-02-06T22:56:15.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.503+0000 7f9c3244b700 1 -- 172.21.15.51:0/2252146424 wait complete. 2021-02-06T22:56:15.505 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:15.503+0000 7f9c3244b700 1 librados: shutdown 2021-02-06T22:56:15.514 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:18.515 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:18.650 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.650+0000 7efed9708700 1 Processor -- start 2021-02-06T22:56:18.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.650+0000 7efed9708700 1 -- start start 2021-02-06T22:56:18.651 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efed9708700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed40915d0 con 0x7efed40928d0 2021-02-06T22:56:18.652 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efed9708700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed4091ac0 con 0x7efed40999a0 2021-02-06T22:56:18.652 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efed9708700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed4091d60 con 0x7efed40629e0 2021-02-06T22:56:18.652 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efecbfff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7efed40629e0 0x7efed4090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60974/0 (socket says 172.21.15.51:60974) 2021-02-06T22:56:18.652 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efecbfff700 1 -- 172.21.15.51:0/3799960939 learned_addr learned my addr 172.21.15.51:0/3799960939 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:18.653 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.651+0000 7efed37fe700 1 --1- 172.21.15.51:0/3799960939 >> v1:172.21.15.51:6789/0 conn(0x7efed40928d0 0x7efed412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60636/0 (socket says 172.21.15.51:60636) 2021-02-06T22:56:18.655 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efecbfff700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.51:6790/0 conn(0x7efed40629e0 legacy=0x7efed4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.655 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed37fe700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.51:6789/0 conn(0x7efed40928d0 legacy=0x7efed412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed2ffd700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.106:6789/0 conn(0x7efed40999a0 legacy=0x7efed40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773903134 0 0) 0x7efed4091d60 con 0x7efed40629e0 2021-02-06T22:56:18.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb4003230 con 0x7efed40629e0 2021-02-06T22:56:18.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601969887 0 0) 0x7efed40915d0 con 0x7efed40928d0 2021-02-06T22:56:18.656 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed4091d60 con 0x7efed40928d0 2021-02-06T22:56:18.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240872836 0 0) 0x7efed4091ac0 con 0x7efed40999a0 2021-02-06T22:56:18.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.653+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed40915d0 con 0x7efed40999a0 2021-02-06T22:56:18.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3826953853 0 0) 0x7efeb4003230 con 0x7efed40629e0 2021-02-06T22:56:18.657 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.106:6789/0 conn(0x7efed40999a0 legacy=0x7efed40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.51:6789/0 conn(0x7efed40928d0 legacy=0x7efed412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4092000 con 0x7efed40629e0 2021-02-06T22:56:18.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efebc001930 con 0x7efed40629e0 2021-02-06T22:56:18.658 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efebc001c40 con 0x7efed40629e0 2021-02-06T22:56:18.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed27fc700 1 -- 172.21.15.51:0/3799960939 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efebc004750 con 0x7efed40629e0 2021-02-06T22:56:18.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed9708700 1 -- 172.21.15.51:0/3799960939 >> v1:172.21.15.51:6790/0 conn(0x7efed40629e0 legacy=0x7efed4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed9708700 1 -- 172.21.15.51:0/3799960939 shutdown_connections 2021-02-06T22:56:18.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed9708700 1 -- 172.21.15.51:0/3799960939 >> 172.21.15.51:0/3799960939 conn(0x7efed4096860 msgr2=0x7efed4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:18.659 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed9708700 1 -- 172.21.15.51:0/3799960939 shutdown_connections 2021-02-06T22:56:18.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.654+0000 7efed9708700 1 -- 172.21.15.51:0/3799960939 wait complete. 2021-02-06T22:56:18.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 librados: starting msgr at 2021-02-06T22:56:18.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 librados: starting objecter 2021-02-06T22:56:18.660 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 Processor -- start 2021-02-06T22:56:18.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 -- start start 2021-02-06T22:56:18.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 librados: setting wanted keys 2021-02-06T22:56:18.661 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.655+0000 7efed9708700 1 librados: calling monclient init 2021-02-06T22:56:18.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.656+0000 7efed9708700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed412d0e0 con 0x7efed40629e0 2021-02-06T22:56:18.664 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.656+0000 7efed9708700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed412e5a0 con 0x7efed40999a0 2021-02-06T22:56:18.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.656+0000 7efed9708700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed412e840 con 0x7efed40928d0 2021-02-06T22:56:18.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.656+0000 7efed2ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7efed40629e0 0x7efed412c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60638/0 (socket says 172.21.15.51:60638) 2021-02-06T22:56:18.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.656+0000 7efed2ffd700 1 -- 172.21.15.51:0/2856104854 learned_addr learned my addr 172.21.15.51:0/2856104854 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:18.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecbfff700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.51:6790/0 conn(0x7efed40928d0 legacy=0x7efed412c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.665 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter ms_handle_connect 0x7efed40928d0 2021-02-06T22:56:18.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:18.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter ms_handle_connect 0x7efed40629e0 2021-02-06T22:56:18.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:18.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efed2ffd700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.51:6789/0 conn(0x7efed40629e0 legacy=0x7efed412c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.666 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859852742 0 0) 0x7efed412e840 con 0x7efed40928d0 2021-02-06T22:56:18.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb8004bd0 con 0x7efed40928d0 2021-02-06T22:56:18.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701603823 0 0) 0x7efed412d0e0 con 0x7efed40629e0 2021-02-06T22:56:18.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed412e840 con 0x7efed40629e0 2021-02-06T22:56:18.667 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter ms_handle_connect 0x7efed40999a0 2021-02-06T22:56:18.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:18.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efed37fe700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.106:6789/0 conn(0x7efed40999a0 legacy=0x7efed4142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:18.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1721242912 0 0) 0x7efeb8004bd0 con 0x7efed40928d0 2021-02-06T22:56:18.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efed412d0e0 con 0x7efed40928d0 2021-02-06T22:56:18.668 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efebc0018f0 con 0x7efed40928d0 2021-02-06T22:56:18.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828767895 0 0) 0x7efed412e5a0 con 0x7efed40999a0 2021-02-06T22:56:18.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb8004bd0 con 0x7efed40999a0 2021-02-06T22:56:18.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1541246203 0 0) 0x7efed412e840 con 0x7efed40629e0 2021-02-06T22:56:18.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efed412e5a0 con 0x7efed40629e0 2021-02-06T22:56:18.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.658+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efec4001cb0 con 0x7efed40629e0 2021-02-06T22:56:18.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1641160854 0 0) 0x7efed412d0e0 con 0x7efed40928d0 2021-02-06T22:56:18.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.106:6789/0 conn(0x7efed40999a0 legacy=0x7efed4142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.51:6789/0 conn(0x7efed40629e0 legacy=0x7efed412c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed412eae0 con 0x7efed40928d0 2021-02-06T22:56:18.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4093e50 con 0x7efed40928d0 2021-02-06T22:56:18.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efed9708700 10 client.4691.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:18.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efed41278e0 con 0x7efed40928d0 2021-02-06T22:56:18.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efed9708700 1 librados: init done 2021-02-06T22:56:18.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efebc004d00 con 0x7efed40928d0 2021-02-06T22:56:18.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efebc005010 con 0x7efed40928d0 2021-02-06T22:56:18.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.659+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7efebc00d7d0 con 0x7efed40928d0 2021-02-06T22:56:18.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7efebc0394f0 con 0x7efed40928d0 2021-02-06T22:56:18.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efecaffd700 10 client.4691.objecter ms_dispatch 0x7efed4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:18.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efecaffd700 3 client.4691.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:18.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efecaffd700 3 client.4691.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:18.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efecaffd700 20 client.4691.objecter dump_active .. 0 homeless 2021-02-06T22:56:18.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.660+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac004d60 con 0x7efed40928d0 2021-02-06T22:56:18.673 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.662+0000 7efecaffd700 10 client.4691.objecter ms_handle_connect 0x7efeb8030770 2021-02-06T22:56:18.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.664+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7efebc0123e0 con 0x7efed40928d0 2021-02-06T22:56:18.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.914+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efeac0059b0 con 0x7efed40928d0 2021-02-06T22:56:18.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.915+0000 7efecaffd700 1 -- 172.21.15.51:0/2856104854 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7efebc011fd0 con 0x7efed40928d0 2021-02-06T22:56:18.915 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:18.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 10 librados: watch_flush enter 2021-02-06T22:56:18.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 10 librados: watch_flush exit 2021-02-06T22:56:18.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 20 client.4691.objecter shutdown clearing up homeless session... 2021-02-06T22:56:18.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 10 client.4691.objecter successfully canceled tick 2021-02-06T22:56:18.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.106:6812/33219 conn(0x7efeb8030770 legacy=0x7efeb8032c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 >> v1:172.21.15.51:6790/0 conn(0x7efed40928d0 legacy=0x7efed412c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:18.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 shutdown_connections 2021-02-06T22:56:18.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 >> 172.21.15.51:0/2856104854 conn(0x7efed4096860 msgr2=0x7efed4097160 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:18.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 shutdown_connections 2021-02-06T22:56:18.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 -- 172.21.15.51:0/2856104854 wait complete. 2021-02-06T22:56:18.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:18.916+0000 7efed9708700 1 librados: shutdown 2021-02-06T22:56:18.928 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:21.929 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:22.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.064+0000 7fde1344c700 1 Processor -- start 2021-02-06T22:56:22.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.064+0000 7fde1344c700 1 -- start start 2021-02-06T22:56:22.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde1344c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c095440 con 0x7fde0c092bf0 2021-02-06T22:56:22.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde1344c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0907b0 con 0x7fde0c08fa70 2021-02-06T22:56:22.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde1344c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c091010 con 0x7fde0c12ce00 2021-02-06T22:56:22.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde109e7700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fde0c092bf0 0x7fde0c0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60646/0 (socket says 172.21.15.51:60646) 2021-02-06T22:56:22.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde119e9700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 0x7fde0c12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60990/0 (socket says 172.21.15.51:60990) 2021-02-06T22:56:22.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.065+0000 7fde109e7700 1 -- 172.21.15.51:0/23713949 learned_addr learned my addr 172.21.15.51:0/23713949 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:22.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fde119e9700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 legacy=0x7fde0c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fde109e7700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.51:6789/0 conn(0x7fde0c092bf0 legacy=0x7fde0c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fde111e8700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.106:6789/0 conn(0x7fde0c08fa70 legacy=0x7fde0c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021722202 0 0) 0x7fde0c091010 con 0x7fde0c12ce00 2021-02-06T22:56:22.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf4003230 con 0x7fde0c12ce00 2021-02-06T22:56:22.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002734264 0 0) 0x7fde0c095440 con 0x7fde0c092bf0 2021-02-06T22:56:22.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.067+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c091010 con 0x7fde0c092bf0 2021-02-06T22:56:22.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087260663 0 0) 0x7fde0c0907b0 con 0x7fde0c08fa70 2021-02-06T22:56:22.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c095440 con 0x7fde0c08fa70 2021-02-06T22:56:22.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3284617345 0 0) 0x7fddf4003230 con 0x7fde0c12ce00 2021-02-06T22:56:22.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.106:6789/0 conn(0x7fde0c08fa70 legacy=0x7fde0c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.51:6789/0 conn(0x7fde0c092bf0 legacy=0x7fde0c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0912b0 con 0x7fde0c12ce00 2021-02-06T22:56:22.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde04001d70 con 0x7fde0c12ce00 2021-02-06T22:56:22.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde04002090 con 0x7fde0c12ce00 2021-02-06T22:56:22.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fddfbfff700 1 -- 172.21.15.51:0/23713949 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde04004a10 con 0x7fde0c12ce00 2021-02-06T22:56:22.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fde1344c700 1 -- 172.21.15.51:0/23713949 >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 legacy=0x7fde0c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fde1344c700 1 -- 172.21.15.51:0/23713949 shutdown_connections 2021-02-06T22:56:22.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fde1344c700 1 -- 172.21.15.51:0/23713949 >> 172.21.15.51:0/23713949 conn(0x7fde0c096860 msgr2=0x7fde0c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:22.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fde1344c700 1 -- 172.21.15.51:0/23713949 shutdown_connections 2021-02-06T22:56:22.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.068+0000 7fde1344c700 1 -- 172.21.15.51:0/23713949 wait complete. 2021-02-06T22:56:22.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 librados: starting msgr at 2021-02-06T22:56:22.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 librados: starting objecter 2021-02-06T22:56:22.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 Processor -- start 2021-02-06T22:56:22.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 -- start start 2021-02-06T22:56:22.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 librados: setting wanted keys 2021-02-06T22:56:22.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.069+0000 7fde1344c700 1 librados: calling monclient init 2021-02-06T22:56:22.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.070+0000 7fde1344c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c097f40 con 0x7fde0c08fa70 2021-02-06T22:56:22.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.070+0000 7fde1344c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c10fcf0 con 0x7fde0c092bf0 2021-02-06T22:56:22.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.070+0000 7fde1344c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c10ff90 con 0x7fde0c12ce00 2021-02-06T22:56:22.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.070+0000 7fde119e9700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 0x7fde0c1424e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:60996/0 (socket says 172.21.15.51:60996) 2021-02-06T22:56:22.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.070+0000 7fde119e9700 1 -- 172.21.15.51:0/1210001697 learned_addr learned my addr 172.21.15.51:0/1210001697 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:22.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fde111e8700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.51:6789/0 conn(0x7fde0c08fa70 legacy=0x7fde0c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.079 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter ms_handle_connect 0x7fde0c08fa70 2021-02-06T22:56:22.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fde109e7700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.106:6789/0 conn(0x7fde0c092bf0 legacy=0x7fde0c13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:22.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter ms_handle_connect 0x7fde0c092bf0 2021-02-06T22:56:22.080 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:22.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter ms_handle_connect 0x7fde0c12ce00 2021-02-06T22:56:22.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fddf97fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:22.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.072+0000 7fde119e9700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 legacy=0x7fde0c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:22.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179350692 0 0) 0x7fde0c097f40 con 0x7fde0c08fa70 2021-02-06T22:56:22.081 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddec004bd0 con 0x7fde0c08fa70 2021-02-06T22:56:22.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325028638 0 0) 0x7fde0c10ff90 con 0x7fde0c12ce00 2021-02-06T22:56:22.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c097f40 con 0x7fde0c12ce00 2021-02-06T22:56:22.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927891143 0 0) 0x7fde0c10fcf0 con 0x7fde0c092bf0 2021-02-06T22:56:22.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde0c10ff90 con 0x7fde0c092bf0 2021-02-06T22:56:22.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2306151070 0 0) 0x7fde0c097f40 con 0x7fde0c12ce00 2021-02-06T22:56:22.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde0c10fcf0 con 0x7fde0c12ce00 2021-02-06T22:56:22.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde04004a10 con 0x7fde0c12ce00 2021-02-06T22:56:22.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2386343159 0 0) 0x7fddec004bd0 con 0x7fde0c08fa70 2021-02-06T22:56:22.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde0c097f40 con 0x7fde0c08fa70 2021-02-06T22:56:22.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fddfc001be0 con 0x7fde0c08fa70 2021-02-06T22:56:22.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 776063583 0 0) 0x7fde0c10ff90 con 0x7fde0c092bf0 2021-02-06T22:56:22.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fddec004bd0 con 0x7fde0c092bf0 2021-02-06T22:56:22.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde08001c60 con 0x7fde0c092bf0 2021-02-06T22:56:22.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3984169571 0 0) 0x7fde0c10fcf0 con 0x7fde0c12ce00 2021-02-06T22:56:22.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.106:6789/0 conn(0x7fde0c092bf0 legacy=0x7fde0c13edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.51:6789/0 conn(0x7fde0c08fa70 legacy=0x7fde0c139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c110230 con 0x7fde0c12ce00 2021-02-06T22:56:22.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c132180 con 0x7fde0c12ce00 2021-02-06T22:56:22.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fde1344c700 10 client.4697.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:22.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c131a70 con 0x7fde0c12ce00 2021-02-06T22:56:22.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fde1344c700 1 librados: init done 2021-02-06T22:56:22.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fde04004ff0 con 0x7fde0c12ce00 2021-02-06T22:56:22.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.073+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fde04005300 con 0x7fde0c12ce00 2021-02-06T22:56:22.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fde0400dac0 con 0x7fde0c12ce00 2021-02-06T22:56:22.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fde04039880 con 0x7fde0c12ce00 2021-02-06T22:56:22.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 10 client.4697.objecter ms_dispatch 0x7fde0c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:22.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 3 client.4697.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:22.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 3 client.4697.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:22.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fddf97fa700 20 client.4697.objecter dump_active .. 0 homeless 2021-02-06T22:56:22.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.074+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde4004d60 con 0x7fde0c12ce00 2021-02-06T22:56:22.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.077+0000 7fddf97fa700 10 client.4697.objecter ms_handle_connect 0x7fddec0309b0 2021-02-06T22:56:22.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.078+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fde040127e0 con 0x7fde0c12ce00 2021-02-06T22:56:22.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.328+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdde40059b0 con 0x7fde0c12ce00 2021-02-06T22:56:22.328 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.329+0000 7fddf97fa700 1 -- 172.21.15.51:0/1210001697 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fde040123d0 con 0x7fde0c12ce00 2021-02-06T22:56:22.328 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:22.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.330+0000 7fde1344c700 10 librados: watch_flush enter 2021-02-06T22:56:22.330 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.330+0000 7fde1344c700 10 librados: watch_flush exit 2021-02-06T22:56:22.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.330+0000 7fde1344c700 20 client.4697.objecter shutdown clearing up homeless session... 2021-02-06T22:56:22.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.330+0000 7fde1344c700 10 client.4697.objecter successfully canceled tick 2021-02-06T22:56:22.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.106:6812/33219 conn(0x7fddec0309b0 legacy=0x7fddec032e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 >> v1:172.21.15.51:6790/0 conn(0x7fde0c12ce00 legacy=0x7fde0c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:22.331 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 shutdown_connections 2021-02-06T22:56:22.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 >> 172.21.15.51:0/1210001697 conn(0x7fde0c096860 msgr2=0x7fde0c093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:22.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 shutdown_connections 2021-02-06T22:56:22.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 -- 172.21.15.51:0/1210001697 wait complete. 2021-02-06T22:56:22.332 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:22.331+0000 7fde1344c700 1 librados: shutdown 2021-02-06T22:56:22.341 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:25.342 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:25.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.478+0000 7efe9bd81700 1 Processor -- start 2021-02-06T22:56:25.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.478+0000 7efe9bd81700 1 -- start start 2021-02-06T22:56:25.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.478+0000 7efe9bd81700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94095440 con 0x7efe94092bf0 2021-02-06T22:56:25.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.478+0000 7efe9bd81700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940907b0 con 0x7efe9408fa70 2021-02-06T22:56:25.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.479+0000 7efe9bd81700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94091010 con 0x7efe9412ce00 2021-02-06T22:56:25.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.479+0000 7efe9931c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7efe94092bf0 0x7efe940930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60662/0 (socket says 172.21.15.51:60662) 2021-02-06T22:56:25.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.479+0000 7efe9a31e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7efe9412ce00 0x7efe9412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32776/0 (socket says 172.21.15.51:32776) 2021-02-06T22:56:25.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.479+0000 7efe9931c700 1 -- 172.21.15.51:0/2986165474 learned_addr learned my addr 172.21.15.51:0/2986165474 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:25.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe9a31e700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.51:6790/0 conn(0x7efe9412ce00 legacy=0x7efe9412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe9931c700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.51:6789/0 conn(0x7efe94092bf0 legacy=0x7efe940930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846194401 0 0) 0x7efe94095440 con 0x7efe94092bf0 2021-02-06T22:56:25.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe99b1d700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.106:6789/0 conn(0x7efe9408fa70 legacy=0x7efe940921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe7c003230 con 0x7efe94092bf0 2021-02-06T22:56:25.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064410151 0 0) 0x7efe94091010 con 0x7efe9412ce00 2021-02-06T22:56:25.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94095440 con 0x7efe9412ce00 2021-02-06T22:56:25.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 549937127 0 0) 0x7efe7c003230 con 0x7efe94092bf0 2021-02-06T22:56:25.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.51:6790/0 conn(0x7efe9412ce00 legacy=0x7efe9412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.106:6789/0 conn(0x7efe9408fa70 legacy=0x7efe940921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940912b0 con 0x7efe94092bf0 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efe90001920 con 0x7efe94092bf0 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe90001c40 con 0x7efe94092bf0 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.481+0000 7efe98b1b700 1 -- 172.21.15.51:0/2986165474 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efe90004750 con 0x7efe94092bf0 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.482+0000 7efe9bd81700 1 -- 172.21.15.51:0/2986165474 >> v1:172.21.15.51:6789/0 conn(0x7efe94092bf0 legacy=0x7efe940930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.482+0000 7efe9bd81700 1 -- 172.21.15.51:0/2986165474 shutdown_connections 2021-02-06T22:56:25.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.482+0000 7efe9bd81700 1 -- 172.21.15.51:0/2986165474 >> 172.21.15.51:0/2986165474 conn(0x7efe94096860 msgr2=0x7efe94099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:25.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.482+0000 7efe9bd81700 1 -- 172.21.15.51:0/2986165474 shutdown_connections 2021-02-06T22:56:25.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.482+0000 7efe9bd81700 1 -- 172.21.15.51:0/2986165474 wait complete. 2021-02-06T22:56:25.488 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 librados: starting msgr at 2021-02-06T22:56:25.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 librados: starting objecter 2021-02-06T22:56:25.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 Processor -- start 2021-02-06T22:56:25.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 -- start start 2021-02-06T22:56:25.489 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 librados: setting wanted keys 2021-02-06T22:56:25.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 librados: calling monclient init 2021-02-06T22:56:25.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94123a90 con 0x7efe9408fa70 2021-02-06T22:56:25.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94090bf0 con 0x7efe94092bf0 2021-02-06T22:56:25.490 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe9bd81700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe94124d00 con 0x7efe9412ce00 2021-02-06T22:56:25.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe99b1d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7efe9408fa70 0x7efe94135640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60668/0 (socket says 172.21.15.51:60668) 2021-02-06T22:56:25.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.483+0000 7efe99b1d700 1 -- 172.21.15.51:0/1809551658 learned_addr learned my addr 172.21.15.51:0/1809551658 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:25.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe99b1d700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.51:6789/0 conn(0x7efe9408fa70 legacy=0x7efe94135640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter ms_handle_connect 0x7efe9408fa70 2021-02-06T22:56:25.491 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:25.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter ms_handle_connect 0x7efe9412ce00 2021-02-06T22:56:25.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:25.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe9a31e700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.51:6790/0 conn(0x7efe9412ce00 legacy=0x7efe9413d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.492 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618709579 0 0) 0x7efe94123a90 con 0x7efe9408fa70 2021-02-06T22:56:25.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe74004bd0 con 0x7efe9408fa70 2021-02-06T22:56:25.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259069000 0 0) 0x7efe94124d00 con 0x7efe9412ce00 2021-02-06T22:56:25.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe94123a90 con 0x7efe9412ce00 2021-02-06T22:56:25.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter ms_handle_connect 0x7efe94092bf0 2021-02-06T22:56:25.493 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe9931c700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.106:6789/0 conn(0x7efe94092bf0 legacy=0x7efe9412c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:25.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:25.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1615506317 0 0) 0x7efe74004bd0 con 0x7efe9408fa70 2021-02-06T22:56:25.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe94124d00 con 0x7efe9408fa70 2021-02-06T22:56:25.494 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efe84001cc0 con 0x7efe9408fa70 2021-02-06T22:56:25.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2209242876 0 0) 0x7efe94123a90 con 0x7efe9412ce00 2021-02-06T22:56:25.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe74004bd0 con 0x7efe9412ce00 2021-02-06T22:56:25.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efe8c001fe0 con 0x7efe9412ce00 2021-02-06T22:56:25.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3798855217 0 0) 0x7efe94124d00 con 0x7efe9408fa70 2021-02-06T22:56:25.495 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.51:6790/0 conn(0x7efe9412ce00 legacy=0x7efe9413d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.106:6789/0 conn(0x7efe94092bf0 legacy=0x7efe9412c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe94124260 con 0x7efe9408fa70 2021-02-06T22:56:25.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe940666c0 con 0x7efe9408fa70 2021-02-06T22:56:25.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efe84002400 con 0x7efe9408fa70 2021-02-06T22:56:25.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efe84002710 con 0x7efe9408fa70 2021-02-06T22:56:25.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.486+0000 7efe9bd81700 10 client.4725.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:25.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9412c920 con 0x7efe9408fa70 2021-02-06T22:56:25.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe9bd81700 1 librados: init done 2021-02-06T22:56:25.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7efe84002920 con 0x7efe9408fa70 2021-02-06T22:56:25.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7efe84039590 con 0x7efe9408fa70 2021-02-06T22:56:25.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 10 client.4725.objecter ms_dispatch 0x7efe94001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:25.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 3 client.4725.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:25.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 3 client.4725.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:25.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe81ffb700 20 client.4725.objecter dump_active .. 0 homeless 2021-02-06T22:56:25.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.487+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe94099f50 con 0x7efe9408fa70 2021-02-06T22:56:25.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.490+0000 7efe81ffb700 10 client.4725.objecter ms_handle_connect 0x7efe740304c0 2021-02-06T22:56:25.499 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.491+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7efe84012420 con 0x7efe9408fa70 2021-02-06T22:56:25.739 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.740+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe940974d0 con 0x7efe9408fa70 2021-02-06T22:56:25.740 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.740+0000 7efe81ffb700 1 -- 172.21.15.51:0/1809551658 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7efe84012010 con 0x7efe9408fa70 2021-02-06T22:56:25.740 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:25.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 10 librados: watch_flush enter 2021-02-06T22:56:25.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 10 librados: watch_flush exit 2021-02-06T22:56:25.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 20 client.4725.objecter shutdown clearing up homeless session... 2021-02-06T22:56:25.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 10 client.4725.objecter successfully canceled tick 2021-02-06T22:56:25.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.106:6812/33219 conn(0x7efe740304c0 legacy=0x7efe74032980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 >> v1:172.21.15.51:6789/0 conn(0x7efe9408fa70 legacy=0x7efe94135640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:25.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 shutdown_connections 2021-02-06T22:56:25.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 >> 172.21.15.51:0/1809551658 conn(0x7efe94096860 msgr2=0x7efe94122fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:25.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 shutdown_connections 2021-02-06T22:56:25.744 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 -- 172.21.15.51:0/1809551658 wait complete. 2021-02-06T22:56:25.744 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:25.742+0000 7efe9bd81700 1 librados: shutdown 2021-02-06T22:56:25.752 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:28.753 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:28.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.889+0000 7fbd5e9ea700 1 Processor -- start 2021-02-06T22:56:28.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.889+0000 7fbd5e9ea700 1 -- start start 2021-02-06T22:56:28.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58095440 con 0x7fbd5808fa70 2021-02-06T22:56:28.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd580907b0 con 0x7fbd58092bf0 2021-02-06T22:56:28.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58091010 con 0x7fbd5812ce00 2021-02-06T22:56:28.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd57fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 0x7fbd580921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60676/0 (socket says 172.21.15.51:60676) 2021-02-06T22:56:28.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd57fff700 1 -- 172.21.15.51:0/3623023702 learned_addr learned my addr 172.21.15.51:0/3623023702 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:28.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.890+0000 7fbd5cf87700 1 --1- 172.21.15.51:0/3623023702 >> v1:172.21.15.51:6790/0 conn(0x7fbd5812ce00 0x7fbd5812f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32790/0 (socket says 172.21.15.51:32790) 2021-02-06T22:56:28.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd5cf87700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.51:6790/0 conn(0x7fbd5812ce00 legacy=0x7fbd5812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd57fff700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 legacy=0x7fbd580921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807579039 0 0) 0x7fbd58095440 con 0x7fbd5808fa70 2021-02-06T22:56:28.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd44003230 con 0x7fbd5808fa70 2021-02-06T22:56:28.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790120790 0 0) 0x7fbd58091010 con 0x7fbd5812ce00 2021-02-06T22:56:28.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd577fe700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.106:6789/0 conn(0x7fbd58092bf0 legacy=0x7fbd580930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58095440 con 0x7fbd5812ce00 2021-02-06T22:56:28.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899254473 0 0) 0x7fbd580907b0 con 0x7fbd58092bf0 2021-02-06T22:56:28.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58091010 con 0x7fbd58092bf0 2021-02-06T22:56:28.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3135115243 0 0) 0x7fbd58095440 con 0x7fbd5812ce00 2021-02-06T22:56:28.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.106:6789/0 conn(0x7fbd58092bf0 legacy=0x7fbd580930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:28.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 legacy=0x7fbd580921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:28.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580912b0 con 0x7fbd5812ce00 2021-02-06T22:56:28.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.892+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd50001cb0 con 0x7fbd5812ce00 2021-02-06T22:56:28.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbd50001fc0 con 0x7fbd5812ce00 2021-02-06T22:56:28.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd56ffd700 1 -- 172.21.15.51:0/3623023702 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd50004a10 con 0x7fbd5812ce00 2021-02-06T22:56:28.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/3623023702 >> v1:172.21.15.51:6790/0 conn(0x7fbd5812ce00 legacy=0x7fbd5812f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:28.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/3623023702 shutdown_connections 2021-02-06T22:56:28.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/3623023702 >> 172.21.15.51:0/3623023702 conn(0x7fbd58096860 msgr2=0x7fbd58099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:28.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/3623023702 shutdown_connections 2021-02-06T22:56:28.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.893+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/3623023702 wait complete. 2021-02-06T22:56:28.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 librados: starting msgr at 2021-02-06T22:56:28.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 librados: starting objecter 2021-02-06T22:56:28.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 Processor -- start 2021-02-06T22:56:28.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 -- start start 2021-02-06T22:56:28.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 librados: setting wanted keys 2021-02-06T22:56:28.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.894+0000 7fbd5e9ea700 1 librados: calling monclient init 2021-02-06T22:56:28.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58130940 con 0x7fbd5808fa70 2021-02-06T22:56:28.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58130b70 con 0x7fbd5812ce00 2021-02-06T22:56:28.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd5e9ea700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd58130000 con 0x7fbd58092bf0 2021-02-06T22:56:28.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd577fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fbd58092bf0 0x7fbd58127390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32794/0 (socket says 172.21.15.51:32794) 2021-02-06T22:56:28.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd57fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 0x7fbd58126c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60682/0 (socket says 172.21.15.51:60682) 2021-02-06T22:56:28.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.895+0000 7fbd577fe700 1 -- 172.21.15.51:0/2868763748 learned_addr learned my addr 172.21.15.51:0/2868763748 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:28.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd57fff700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 legacy=0x7fbd58126c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd577fe700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.51:6790/0 conn(0x7fbd58092bf0 legacy=0x7fbd58127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter ms_handle_connect 0x7fbd5808fa70 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter ms_handle_connect 0x7fbd58092bf0 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter ms_handle_connect 0x7fbd5812ce00 2021-02-06T22:56:28.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:28.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd5cf87700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.106:6789/0 conn(0x7fbd5812ce00 legacy=0x7fbd5813fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:28.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243402347 0 0) 0x7fbd58130000 con 0x7fbd58092bf0 2021-02-06T22:56:28.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd38004bd0 con 0x7fbd58092bf0 2021-02-06T22:56:28.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166920105 0 0) 0x7fbd58130940 con 0x7fbd5808fa70 2021-02-06T22:56:28.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58130000 con 0x7fbd5808fa70 2021-02-06T22:56:28.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578452422 0 0) 0x7fbd58130b70 con 0x7fbd5812ce00 2021-02-06T22:56:28.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58130940 con 0x7fbd5812ce00 2021-02-06T22:56:28.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1028954172 0 0) 0x7fbd38004bd0 con 0x7fbd58092bf0 2021-02-06T22:56:28.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd58130b70 con 0x7fbd58092bf0 2021-02-06T22:56:28.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.897+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd4c001c40 con 0x7fbd58092bf0 2021-02-06T22:56:28.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 70710686 0 0) 0x7fbd58130000 con 0x7fbd5808fa70 2021-02-06T22:56:28.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd38004bd0 con 0x7fbd5808fa70 2021-02-06T22:56:28.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd48001b90 con 0x7fbd5808fa70 2021-02-06T22:56:28.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1185451158 0 0) 0x7fbd58130940 con 0x7fbd5812ce00 2021-02-06T22:56:28.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbd58130000 con 0x7fbd5812ce00 2021-02-06T22:56:28.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd50001c70 con 0x7fbd5812ce00 2021-02-06T22:56:28.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 861070850 0 0) 0x7fbd58130b70 con 0x7fbd58092bf0 2021-02-06T22:56:28.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.106:6789/0 conn(0x7fbd5812ce00 legacy=0x7fbd5813fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:28.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.51:6789/0 conn(0x7fbd5808fa70 legacy=0x7fbd58126c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:28.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58090bf0 con 0x7fbd58092bf0 2021-02-06T22:56:28.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5812ea00 con 0x7fbd58092bf0 2021-02-06T22:56:28.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd5e9ea700 10 client.4709.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:28.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd581316f0 con 0x7fbd58092bf0 2021-02-06T22:56:28.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd5e9ea700 1 librados: init done 2021-02-06T22:56:28.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fbd4c0023a0 con 0x7fbd58092bf0 2021-02-06T22:56:28.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fbd4c0026b0 con 0x7fbd58092bf0 2021-02-06T22:56:28.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.898+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fbd4c002810 con 0x7fbd58092bf0 2021-02-06T22:56:28.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fbd4c039520 con 0x7fbd58092bf0 2021-02-06T22:56:28.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd3ffff700 10 client.4709.objecter ms_dispatch 0x7fbd58001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:28.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd3ffff700 3 client.4709.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:28.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd3ffff700 3 client.4709.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:28.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd3ffff700 20 client.4709.objecter dump_active .. 0 homeless 2021-02-06T22:56:28.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.899+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30004d60 con 0x7fbd58092bf0 2021-02-06T22:56:28.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.901+0000 7fbd3ffff700 10 client.4709.objecter ms_handle_connect 0x7fbd380307b0 2021-02-06T22:56:28.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:28.903+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fbd4c012410 con 0x7fbd58092bf0 2021-02-06T22:56:29.152 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.153+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbd300059b0 con 0x7fbd58092bf0 2021-02-06T22:56:29.153 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.154+0000 7fbd3ffff700 1 -- 172.21.15.51:0/2868763748 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fbd4c012020 con 0x7fbd58092bf0 2021-02-06T22:56:29.153 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:29.154 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 10 librados: watch_flush enter 2021-02-06T22:56:29.155 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 10 librados: watch_flush exit 2021-02-06T22:56:29.155 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 20 client.4709.objecter shutdown clearing up homeless session... 2021-02-06T22:56:29.155 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 10 client.4709.objecter successfully canceled tick 2021-02-06T22:56:29.155 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.106:6812/33219 conn(0x7fbd380307b0 legacy=0x7fbd38032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:29.155 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 >> v1:172.21.15.51:6790/0 conn(0x7fbd58092bf0 legacy=0x7fbd58127390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:29.156 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 shutdown_connections 2021-02-06T22:56:29.156 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 >> 172.21.15.51:0/2868763748 conn(0x7fbd58096860 msgr2=0x7fbd58093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:29.156 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 shutdown_connections 2021-02-06T22:56:29.156 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 -- 172.21.15.51:0/2868763748 wait complete. 2021-02-06T22:56:29.156 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:29.155+0000 7fbd5e9ea700 1 librados: shutdown 2021-02-06T22:56:29.165 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:32.166 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:32.302 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.303+0000 7f24cb78d700 1 Processor -- start 2021-02-06T22:56:32.302 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.303+0000 7f24cb78d700 1 -- start start 2021-02-06T22:56:32.303 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24cb78d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c4095440 con 0x7f24c408fa70 2021-02-06T22:56:32.304 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24cb78d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40907b0 con 0x7f24c412ce00 2021-02-06T22:56:32.304 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24cb78d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c4091010 con 0x7f24c4092bf0 2021-02-06T22:56:32.304 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24c8d28700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f24c4092bf0 0x7f24c40930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32806/0 (socket says 172.21.15.51:32806) 2021-02-06T22:56:32.304 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24c9529700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f24c408fa70 0x7f24c40921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60694/0 (socket says 172.21.15.51:60694) 2021-02-06T22:56:32.304 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.304+0000 7f24c8d28700 1 -- 172.21.15.51:0/561637312 learned_addr learned my addr 172.21.15.51:0/561637312 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:32.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24c9529700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.51:6789/0 conn(0x7f24c408fa70 legacy=0x7f24c40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24c8d28700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.51:6790/0 conn(0x7f24c4092bf0 legacy=0x7f24c40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111529038 0 0) 0x7f24c4095440 con 0x7f24c408fa70 2021-02-06T22:56:32.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ac003230 con 0x7f24c408fa70 2021-02-06T22:56:32.307 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24c9d2a700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.106:6789/0 conn(0x7f24c412ce00 legacy=0x7f24c412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955336860 0 0) 0x7f24c4091010 con 0x7f24c4092bf0 2021-02-06T22:56:32.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c4095440 con 0x7f24c4092bf0 2021-02-06T22:56:32.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420620337 0 0) 0x7f24c40907b0 con 0x7f24c412ce00 2021-02-06T22:56:32.308 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c4091010 con 0x7f24c412ce00 2021-02-06T22:56:32.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1724736577 0 0) 0x7f24c4095440 con 0x7f24c4092bf0 2021-02-06T22:56:32.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.106:6789/0 conn(0x7f24c412ce00 legacy=0x7f24c412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.51:6789/0 conn(0x7f24c408fa70 legacy=0x7f24c40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.309 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40912b0 con 0x7f24c4092bf0 2021-02-06T22:56:32.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.306+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24c0001930 con 0x7f24c4092bf0 2021-02-06T22:56:32.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f24c0001c40 con 0x7f24c4092bf0 2021-02-06T22:56:32.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24b3fff700 1 -- 172.21.15.51:0/561637312 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24c0004750 con 0x7f24c4092bf0 2021-02-06T22:56:32.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24cb78d700 1 -- 172.21.15.51:0/561637312 >> v1:172.21.15.51:6790/0 conn(0x7f24c4092bf0 legacy=0x7f24c40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.310 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24cb78d700 1 -- 172.21.15.51:0/561637312 shutdown_connections 2021-02-06T22:56:32.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24cb78d700 1 -- 172.21.15.51:0/561637312 >> 172.21.15.51:0/561637312 conn(0x7f24c4096860 msgr2=0x7f24c4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:32.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24cb78d700 1 -- 172.21.15.51:0/561637312 shutdown_connections 2021-02-06T22:56:32.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.307+0000 7f24cb78d700 1 -- 172.21.15.51:0/561637312 wait complete. 2021-02-06T22:56:32.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 librados: starting msgr at 2021-02-06T22:56:32.311 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 librados: starting objecter 2021-02-06T22:56:32.314 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 Processor -- start 2021-02-06T22:56:32.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 -- start start 2021-02-06T22:56:32.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 librados: setting wanted keys 2021-02-06T22:56:32.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.308+0000 7f24cb78d700 1 librados: calling monclient init 2021-02-06T22:56:32.315 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24cb78d700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c4090bf0 con 0x7f24c4092bf0 2021-02-06T22:56:32.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24cb78d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c41365e0 con 0x7f24c412ce00 2021-02-06T22:56:32.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24cb78d700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c4129b00 con 0x7f24c408fa70 2021-02-06T22:56:32.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24c8d28700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f24c4092bf0 0x7f24c412b250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60702/0 (socket says 172.21.15.51:60702) 2021-02-06T22:56:32.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24c9529700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f24c408fa70 0x7f24c4135710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32810/0 (socket says 172.21.15.51:32810) 2021-02-06T22:56:32.316 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.309+0000 7f24c8d28700 1 -- 172.21.15.51:0/2722243084 learned_addr learned my addr 172.21.15.51:0/2722243084 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:32.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24c8d28700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.51:6789/0 conn(0x7f24c4092bf0 legacy=0x7f24c412b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24c9529700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.51:6790/0 conn(0x7f24c408fa70 legacy=0x7f24c4135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter ms_handle_connect 0x7f24c4092bf0 2021-02-06T22:56:32.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:32.317 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter ms_handle_connect 0x7f24c408fa70 2021-02-06T22:56:32.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:32.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24c9d2a700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.106:6789/0 conn(0x7f24c412ce00 legacy=0x7f24c413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:32.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984358508 0 0) 0x7f24c4090bf0 con 0x7f24c4092bf0 2021-02-06T22:56:32.318 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24a4004bd0 con 0x7f24c4092bf0 2021-02-06T22:56:32.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter ms_handle_connect 0x7f24c412ce00 2021-02-06T22:56:32.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:32.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823921917 0 0) 0x7f24c4129b00 con 0x7f24c408fa70 2021-02-06T22:56:32.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c4090bf0 con 0x7f24c408fa70 2021-02-06T22:56:32.319 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285649222 0 0) 0x7f24c41365e0 con 0x7f24c412ce00 2021-02-06T22:56:32.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c4129b00 con 0x7f24c412ce00 2021-02-06T22:56:32.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1598890431 0 0) 0x7f24a4004bd0 con 0x7f24c4092bf0 2021-02-06T22:56:32.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24c41365e0 con 0x7f24c4092bf0 2021-02-06T22:56:32.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24c00018f0 con 0x7f24c4092bf0 2021-02-06T22:56:32.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2985288636 0 0) 0x7f24c4090bf0 con 0x7f24c408fa70 2021-02-06T22:56:32.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24a4004bd0 con 0x7f24c408fa70 2021-02-06T22:56:32.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24b4001c60 con 0x7f24c408fa70 2021-02-06T22:56:32.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.311+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4047557544 0 0) 0x7f24c4129b00 con 0x7f24c412ce00 2021-02-06T22:56:32.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f24c4090bf0 con 0x7f24c412ce00 2021-02-06T22:56:32.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24bc001f60 con 0x7f24c412ce00 2021-02-06T22:56:32.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1145030397 0 0) 0x7f24a4004bd0 con 0x7f24c408fa70 2021-02-06T22:56:32.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.106:6789/0 conn(0x7f24c412ce00 legacy=0x7f24c413da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.51:6789/0 conn(0x7f24c4092bf0 legacy=0x7f24c412b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4129da0 con 0x7f24c408fa70 2021-02-06T22:56:32.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4128710 con 0x7f24c408fa70 2021-02-06T22:56:32.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24cb78d700 10 client.4715.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:32.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c412b960 con 0x7f24c408fa70 2021-02-06T22:56:32.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24cb78d700 1 librados: init done 2021-02-06T22:56:32.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f24b40047a0 con 0x7f24c408fa70 2021-02-06T22:56:32.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f24b4004ab0 con 0x7f24c408fa70 2021-02-06T22:56:32.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.312+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f24b400d270 con 0x7f24c408fa70 2021-02-06T22:56:32.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c004d60 con 0x7f24c408fa70 2021-02-06T22:56:32.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f24b40392b0 con 0x7f24c408fa70 2021-02-06T22:56:32.324 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24b17fa700 10 client.4715.objecter ms_dispatch 0x7f24c4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:32.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24b17fa700 3 client.4715.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:32.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24b17fa700 3 client.4715.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:32.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.313+0000 7f24b17fa700 20 client.4715.objecter dump_active .. 0 homeless 2021-02-06T22:56:32.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.315+0000 7f24b17fa700 10 client.4715.objecter ms_handle_connect 0x7f24a4030810 2021-02-06T22:56:32.325 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.317+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f24b4012140 con 0x7f24c408fa70 2021-02-06T22:56:32.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.563+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f249c0059b0 con 0x7f24c408fa70 2021-02-06T22:56:32.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.564+0000 7f24b17fa700 1 -- 172.21.15.51:0/2722243084 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f24b4011d30 con 0x7f24c408fa70 2021-02-06T22:56:32.563 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:32.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 10 librados: watch_flush enter 2021-02-06T22:56:32.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 10 librados: watch_flush exit 2021-02-06T22:56:32.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 20 client.4715.objecter shutdown clearing up homeless session... 2021-02-06T22:56:32.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 10 client.4715.objecter successfully canceled tick 2021-02-06T22:56:32.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.106:6812/33219 conn(0x7f24a4030810 legacy=0x7f24a4032cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 >> v1:172.21.15.51:6790/0 conn(0x7f24c408fa70 legacy=0x7f24c4135710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:32.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 shutdown_connections 2021-02-06T22:56:32.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 >> 172.21.15.51:0/2722243084 conn(0x7f24c4096860 msgr2=0x7f24c412c290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:32.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 shutdown_connections 2021-02-06T22:56:32.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.565+0000 7f24cb78d700 1 -- 172.21.15.51:0/2722243084 wait complete. 2021-02-06T22:56:32.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:32.566+0000 7f24cb78d700 1 librados: shutdown 2021-02-06T22:56:32.576 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:35.576 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:35.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.712+0000 7f2c8bfff700 1 Processor -- start 2021-02-06T22:56:35.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.712+0000 7f2c8bfff700 1 -- start start 2021-02-06T22:56:35.712 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8bfff700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c099e60 con 0x7f2c8c1275f0 2021-02-06T22:56:35.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8bfff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c097760 con 0x7f2c8c127170 2021-02-06T22:56:35.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8bfff700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c0940c0 con 0x7f2c8c0933c0 2021-02-06T22:56:35.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8b7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 0x7f2c8c132ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60710/0 (socket says 172.21.15.51:60710) 2021-02-06T22:56:35.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8affd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f2c8c0933c0 0x7f2c8c097050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32818/0 (socket says 172.21.15.51:32818) 2021-02-06T22:56:35.713 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.713+0000 7f2c8b7fe700 1 -- 172.21.15.51:0/2376380714 learned_addr learned my addr 172.21.15.51:0/2376380714 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:35.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c8affd700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.51:6790/0 conn(0x7f2c8c0933c0 legacy=0x7f2c8c097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c8b7fe700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 legacy=0x7f2c8c132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c8a7fc700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.106:6789/0 conn(0x7f2c8c127170 legacy=0x7f2c8c12f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.716 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117811611 0 0) 0x7f2c8c097760 con 0x7f2c8c127170 2021-02-06T22:56:35.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c78003230 con 0x7f2c8c127170 2021-02-06T22:56:35.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710189372 0 0) 0x7f2c8c0940c0 con 0x7f2c8c0933c0 2021-02-06T22:56:35.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c097760 con 0x7f2c8c0933c0 2021-02-06T22:56:35.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083389332 0 0) 0x7f2c8c099e60 con 0x7f2c8c1275f0 2021-02-06T22:56:35.717 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.715+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c0940c0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 661316960 0 0) 0x7f2c78003230 con 0x7f2c8c127170 2021-02-06T22:56:35.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.51:6790/0 conn(0x7f2c8c0933c0 legacy=0x7f2c8c097050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 legacy=0x7f2c8c132ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.718 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c127a80 con 0x7f2c8c127170 2021-02-06T22:56:35.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2c80001980 con 0x7f2c8c127170 2021-02-06T22:56:35.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.1 v1:172.21.15.106:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c80001c90 con 0x7f2c8c127170 2021-02-06T22:56:35.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c89ffb700 1 -- 172.21.15.51:0/2376380714 <== mon.1 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2c80002060 con 0x7f2c8c127170 2021-02-06T22:56:35.719 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c8bfff700 1 -- 172.21.15.51:0/2376380714 >> v1:172.21.15.106:6789/0 conn(0x7f2c8c127170 legacy=0x7f2c8c12f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c8bfff700 1 -- 172.21.15.51:0/2376380714 shutdown_connections 2021-02-06T22:56:35.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c8bfff700 1 -- 172.21.15.51:0/2376380714 >> 172.21.15.51:0/2376380714 conn(0x7f2c8c09a1b0 msgr2=0x7f2c8c09a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:35.720 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c8bfff700 1 -- 172.21.15.51:0/2376380714 shutdown_connections 2021-02-06T22:56:35.722 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.716+0000 7f2c8bfff700 1 -- 172.21.15.51:0/2376380714 wait complete. 2021-02-06T22:56:35.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 librados: starting msgr at 2021-02-06T22:56:35.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 librados: starting objecter 2021-02-06T22:56:35.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 Processor -- start 2021-02-06T22:56:35.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 -- start start 2021-02-06T22:56:35.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 librados: setting wanted keys 2021-02-06T22:56:35.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.717+0000 7f2c8bfff700 1 librados: calling monclient init 2021-02-06T22:56:35.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8bfff700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c1227d0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8bfff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c122a70 con 0x7f2c8c0933c0 2021-02-06T22:56:35.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8bfff700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c099340 con 0x7f2c8c127170 2021-02-06T22:56:35.729 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8a7fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f2c8c127170 0x7f2c8c133a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32826/0 (socket says 172.21.15.51:32826) 2021-02-06T22:56:35.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8a7fc700 1 -- 172.21.15.51:0/3706456435 learned_addr learned my addr 172.21.15.51:0/3706456435 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:35.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.718+0000 7f2c8b7fe700 1 --1- 172.21.15.51:0/3706456435 >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 0x7f2c8c141940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60718/0 (socket says 172.21.15.51:60718) 2021-02-06T22:56:35.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c8b7fe700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 legacy=0x7f2c8c141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.730 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c8a7fc700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.51:6790/0 conn(0x7f2c8c127170 legacy=0x7f2c8c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter ms_handle_connect 0x7f2c8c1275f0 2021-02-06T22:56:35.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:35.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter ms_handle_connect 0x7f2c8c127170 2021-02-06T22:56:35.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:35.731 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter ms_handle_connect 0x7f2c8c0933c0 2021-02-06T22:56:35.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:35.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c8affd700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.106:6789/0 conn(0x7f2c8c0933c0 legacy=0x7f2c8c133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:35.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709112090 0 0) 0x7f2c8c1227d0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c004bd0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.732 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133146096 0 0) 0x7f2c8c099340 con 0x7f2c8c127170 2021-02-06T22:56:35.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c1227d0 con 0x7f2c8c127170 2021-02-06T22:56:35.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294051894 0 0) 0x7f2c8c122a70 con 0x7f2c8c0933c0 2021-02-06T22:56:35.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.720+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c8c099340 con 0x7f2c8c0933c0 2021-02-06T22:56:35.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3524141449 0 0) 0x7f2c6c004bd0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.733 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c8c122a70 con 0x7f2c8c1275f0 2021-02-06T22:56:35.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2c84001c50 con 0x7f2c8c1275f0 2021-02-06T22:56:35.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3224096057 0 0) 0x7f2c8c1227d0 con 0x7f2c8c127170 2021-02-06T22:56:35.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2c6c004bd0 con 0x7f2c8c127170 2021-02-06T22:56:35.734 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2c80001940 con 0x7f2c8c127170 2021-02-06T22:56:35.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 515026934 0 0) 0x7f2c8c122a70 con 0x7f2c8c1275f0 2021-02-06T22:56:35.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.51:6790/0 conn(0x7f2c8c127170 legacy=0x7f2c8c133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.106:6789/0 conn(0x7f2c8c0933c0 legacy=0x7f2c8c133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c121370 con 0x7f2c8c1275f0 2021-02-06T22:56:35.735 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8c123420 con 0x7f2c8c1275f0 2021-02-06T22:56:35.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c8bfff700 10 client.4743.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:35.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c11fe60 con 0x7f2c8c1275f0 2021-02-06T22:56:35.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c8bfff700 1 librados: init done 2021-02-06T22:56:35.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f2c84004be0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.736 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.721+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2c84004ef0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f2c840050d0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f2c840397a0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 10 client.4743.objecter ms_dispatch 0x7f2c8c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:35.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 3 client.4743.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:35.737 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 3 client.4743.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:35.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64004d60 con 0x7f2c8c1275f0 2021-02-06T22:56:35.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.722+0000 7f2c72ffd700 20 client.4743.objecter dump_active .. 0 homeless 2021-02-06T22:56:35.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.724+0000 7f2c72ffd700 10 client.4743.objecter ms_handle_connect 0x7f2c6c0304d0 2021-02-06T22:56:35.738 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.726+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f2c840065d0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.982+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2c640059b0 con 0x7f2c8c1275f0 2021-02-06T22:56:35.982 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.983+0000 7f2c72ffd700 1 -- 172.21.15.51:0/3706456435 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f2c84012280 con 0x7f2c8c1275f0 2021-02-06T22:56:35.982 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:35.984 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 10 librados: watch_flush enter 2021-02-06T22:56:35.984 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 10 librados: watch_flush exit 2021-02-06T22:56:35.984 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 20 client.4743.objecter shutdown clearing up homeless session... 2021-02-06T22:56:35.984 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 10 client.4743.objecter successfully canceled tick 2021-02-06T22:56:35.985 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.106:6812/33219 conn(0x7f2c6c0304d0 legacy=0x7f2c6c032990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.985 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 >> v1:172.21.15.51:6789/0 conn(0x7f2c8c1275f0 legacy=0x7f2c8c141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:35.985 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 shutdown_connections 2021-02-06T22:56:35.985 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 >> 172.21.15.51:0/3706456435 conn(0x7f2c8c09a1b0 msgr2=0x7f2c8c125d40 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:35.985 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 shutdown_connections 2021-02-06T22:56:35.986 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 -- 172.21.15.51:0/3706456435 wait complete. 2021-02-06T22:56:35.986 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:35.984+0000 7f2c8bfff700 1 librados: shutdown 2021-02-06T22:56:35.994 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:38.996 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:39.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.131+0000 7f575511e700 1 Processor -- start 2021-02-06T22:56:39.130 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.131+0000 7f575511e700 1 -- start start 2021-02-06T22:56:39.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.131+0000 7f575511e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57500953e0 con 0x7f575008f510 2021-02-06T22:56:39.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.131+0000 7f575511e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5750094900 con 0x7f575012cd50 2021-02-06T22:56:39.131 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.131+0000 7f575511e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5750090dd0 con 0x7f5750091f60 2021-02-06T22:56:39.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.132+0000 7f574ffff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f575008f510 0x7f5750093ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60722/0 (socket says 172.21.15.51:60722) 2021-02-06T22:56:39.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.132+0000 7f574f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5750091f60 0x7f57500941f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32832/0 (socket says 172.21.15.51:32832) 2021-02-06T22:56:39.132 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.132+0000 7f574ffff700 1 -- 172.21.15.51:0/1245076802 learned_addr learned my addr 172.21.15.51:0/1245076802 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:39.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574ffff700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.51:6789/0 conn(0x7f575008f510 legacy=0x7f5750093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574f7fe700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.51:6790/0 conn(0x7f5750091f60 legacy=0x7f57500941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.134 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389170178 0 0) 0x7f5750090dd0 con 0x7f5750091f60 2021-02-06T22:56:39.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f573c003230 con 0x7f5750091f60 2021-02-06T22:56:39.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728253486 0 0) 0x7f57500953e0 con 0x7f575008f510 2021-02-06T22:56:39.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5750090dd0 con 0x7f575008f510 2021-02-06T22:56:39.135 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f575491d700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.106:6789/0 conn(0x7f575012cd50 legacy=0x7f575012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240080563 0 0) 0x7f5750094900 con 0x7f575012cd50 2021-02-06T22:56:39.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57500953e0 con 0x7f575012cd50 2021-02-06T22:56:39.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3710419332 0 0) 0x7f5750090dd0 con 0x7f575008f510 2021-02-06T22:56:39.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.51:6790/0 conn(0x7f5750091f60 legacy=0x7f57500941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.136 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.106:6789/0 conn(0x7f575012cd50 legacy=0x7f575012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750091070 con 0x7f575008f510 2021-02-06T22:56:39.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f57400018b0 con 0x7f575008f510 2021-02-06T22:56:39.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5740001bc0 con 0x7f575008f510 2021-02-06T22:56:39.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.134+0000 7f574effd700 1 -- 172.21.15.51:0/1245076802 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5740004750 con 0x7f575008f510 2021-02-06T22:56:39.137 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.135+0000 7f575511e700 1 -- 172.21.15.51:0/1245076802 >> v1:172.21.15.51:6789/0 conn(0x7f575008f510 legacy=0x7f5750093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.135+0000 7f575511e700 1 -- 172.21.15.51:0/1245076802 shutdown_connections 2021-02-06T22:56:39.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.135+0000 7f575511e700 1 -- 172.21.15.51:0/1245076802 >> 172.21.15.51:0/1245076802 conn(0x7f5750095be0 msgr2=0x7f5750095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:39.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.135+0000 7f575511e700 1 -- 172.21.15.51:0/1245076802 shutdown_connections 2021-02-06T22:56:39.138 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.135+0000 7f575511e700 1 -- 172.21.15.51:0/1245076802 wait complete. 2021-02-06T22:56:39.141 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 librados: starting msgr at 2021-02-06T22:56:39.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 librados: starting objecter 2021-02-06T22:56:39.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 Processor -- start 2021-02-06T22:56:39.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 -- start start 2021-02-06T22:56:39.142 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 librados: setting wanted keys 2021-02-06T22:56:39.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 librados: calling monclient init 2021-02-06T22:56:39.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57501289d0 con 0x7f5750091f60 2021-02-06T22:56:39.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57501359a0 con 0x7f575012cd50 2021-02-06T22:56:39.143 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.136+0000 7f575511e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5750090830 con 0x7f575008f510 2021-02-06T22:56:39.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.137+0000 7f574ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f575008f510 0x7f5750135290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32838/0 (socket says 172.21.15.51:32838) 2021-02-06T22:56:39.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.137+0000 7f574ffff700 1 -- 172.21.15.51:0/2957442044 learned_addr learned my addr 172.21.15.51:0/2957442044 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:39.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f574f7fe700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.51:6789/0 conn(0x7f5750091f60 legacy=0x7f5750124940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter ms_handle_connect 0x7f5750091f60 2021-02-06T22:56:39.144 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:39.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter ms_handle_connect 0x7f575008f510 2021-02-06T22:56:39.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:39.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f574ffff700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.51:6790/0 conn(0x7f575008f510 legacy=0x7f5750135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521335241 0 0) 0x7f57501289d0 con 0x7f5750091f60 2021-02-06T22:56:39.145 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5730004bd0 con 0x7f5750091f60 2021-02-06T22:56:39.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720556846 0 0) 0x7f5750090830 con 0x7f575008f510 2021-02-06T22:56:39.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57501289d0 con 0x7f575008f510 2021-02-06T22:56:39.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter ms_handle_connect 0x7f575012cd50 2021-02-06T22:56:39.146 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:39.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f575491d700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.106:6789/0 conn(0x7f575012cd50 legacy=0x7f575013d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:39.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 624869760 0 0) 0x7f5730004bd0 con 0x7f5750091f60 2021-02-06T22:56:39.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5750090830 con 0x7f5750091f60 2021-02-06T22:56:39.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5744001c60 con 0x7f5750091f60 2021-02-06T22:56:39.147 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2423794349 0 0) 0x7f57501289d0 con 0x7f575008f510 2021-02-06T22:56:39.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5730004bd0 con 0x7f575008f510 2021-02-06T22:56:39.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5740001870 con 0x7f575008f510 2021-02-06T22:56:39.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714285128 0 0) 0x7f57500953e0 con 0x7f575012cd50 2021-02-06T22:56:39.148 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57501289d0 con 0x7f575012cd50 2021-02-06T22:56:39.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 534898802 0 0) 0x7f5750090830 con 0x7f5750091f60 2021-02-06T22:56:39.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.51:6790/0 conn(0x7f575008f510 legacy=0x7f5750135290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.106:6789/0 conn(0x7f575012cd50 legacy=0x7f575013d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750125090 con 0x7f5750091f60 2021-02-06T22:56:39.149 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5750067510 con 0x7f5750091f60 2021-02-06T22:56:39.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f575511e700 10 client.4749.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:39.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5750065e80 con 0x7f5750091f60 2021-02-06T22:56:39.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.139+0000 7f575511e700 1 librados: init done 2021-02-06T22:56:39.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f57440048e0 con 0x7f5750091f60 2021-02-06T22:56:39.150 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5744004bf0 con 0x7f5750091f60 2021-02-06T22:56:39.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f5744004d50 con 0x7f5750091f60 2021-02-06T22:56:39.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728004d60 con 0x7f5750091f60 2021-02-06T22:56:39.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f5744039540 con 0x7f5750091f60 2021-02-06T22:56:39.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 10 client.4749.objecter ms_dispatch 0x7f5750001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:39.151 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 3 client.4749.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:39.152 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 3 client.4749.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:39.152 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.140+0000 7f5737fff700 20 client.4749.objecter dump_active .. 0 homeless 2021-02-06T22:56:39.153 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.143+0000 7f5737fff700 10 client.4749.objecter ms_handle_connect 0x7f5730030630 2021-02-06T22:56:39.153 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.144+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f57440123d0 con 0x7f5750091f60 2021-02-06T22:56:39.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.395+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f57280059b0 con 0x7f5750091f60 2021-02-06T22:56:39.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.395+0000 7f5737fff700 1 -- 172.21.15.51:0/2957442044 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f5744011fc0 con 0x7f5750091f60 2021-02-06T22:56:39.395 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:39.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 10 librados: watch_flush enter 2021-02-06T22:56:39.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 10 librados: watch_flush exit 2021-02-06T22:56:39.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 20 client.4749.objecter shutdown clearing up homeless session... 2021-02-06T22:56:39.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 10 client.4749.objecter successfully canceled tick 2021-02-06T22:56:39.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.106:6812/33219 conn(0x7f5730030630 legacy=0x7f5730032af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 >> v1:172.21.15.51:6789/0 conn(0x7f5750091f60 legacy=0x7f5750124940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:39.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 shutdown_connections 2021-02-06T22:56:39.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 >> 172.21.15.51:0/2957442044 conn(0x7f5750095be0 msgr2=0x7f5750127b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:39.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 shutdown_connections 2021-02-06T22:56:39.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 -- 172.21.15.51:0/2957442044 wait complete. 2021-02-06T22:56:39.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:39.397+0000 7f575511e700 1 librados: shutdown 2021-02-06T22:56:39.407 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:42.408 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:42.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.543+0000 7f8aa4e5c700 1 Processor -- start 2021-02-06T22:56:42.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.543+0000 7f8aa4e5c700 1 -- start start 2021-02-06T22:56:42.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0095440 con 0x7f8aa008fa70 2021-02-06T22:56:42.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa00907b0 con 0x7f8aa012ce00 2021-02-06T22:56:42.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0091010 con 0x7f8aa0092bf0 2021-02-06T22:56:42.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8a9dd9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8aa0092bf0 0x7f8aa00930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32846/0 (socket says 172.21.15.51:32846) 2021-02-06T22:56:42.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8a9e59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f8aa008fa70 0x7f8aa00921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60736/0 (socket says 172.21.15.51:60736) 2021-02-06T22:56:42.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.544+0000 7f8a9dd9b700 1 -- 172.21.15.51:0/2298238162 learned_addr learned my addr 172.21.15.51:0/2298238162 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:42.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9dd9b700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.51:6790/0 conn(0x7f8aa0092bf0 legacy=0x7f8aa00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9e59c700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.51:6789/0 conn(0x7f8aa008fa70 legacy=0x7f8aa00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9ed9d700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.106:6789/0 conn(0x7f8aa012ce00 legacy=0x7f8aa012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206659338 0 0) 0x7f8aa0091010 con 0x7f8aa0092bf0 2021-02-06T22:56:42.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a84003230 con 0x7f8aa0092bf0 2021-02-06T22:56:42.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4111634656 0 0) 0x7f8aa0095440 con 0x7f8aa008fa70 2021-02-06T22:56:42.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.546+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0091010 con 0x7f8aa008fa70 2021-02-06T22:56:42.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960414945 0 0) 0x7f8aa00907b0 con 0x7f8aa012ce00 2021-02-06T22:56:42.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0095440 con 0x7f8aa012ce00 2021-02-06T22:56:42.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 926969581 0 0) 0x7f8a84003230 con 0x7f8aa0092bf0 2021-02-06T22:56:42.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.106:6789/0 conn(0x7f8aa012ce00 legacy=0x7f8aa012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.51:6789/0 conn(0x7f8aa008fa70 legacy=0x7f8aa00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa00912b0 con 0x7f8aa0092bf0 2021-02-06T22:56:42.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a94001930 con 0x7f8aa0092bf0 2021-02-06T22:56:42.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8a94001c40 con 0x7f8aa0092bf0 2021-02-06T22:56:42.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8a9d59a700 1 -- 172.21.15.51:0/2298238162 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a94004750 con 0x7f8aa0092bf0 2021-02-06T22:56:42.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/2298238162 >> v1:172.21.15.51:6790/0 conn(0x7f8aa0092bf0 legacy=0x7f8aa00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/2298238162 shutdown_connections 2021-02-06T22:56:42.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/2298238162 >> 172.21.15.51:0/2298238162 conn(0x7f8aa0096860 msgr2=0x7f8aa0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:42.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.547+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/2298238162 shutdown_connections 2021-02-06T22:56:42.551 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/2298238162 wait complete. 2021-02-06T22:56:42.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 librados: starting msgr at 2021-02-06T22:56:42.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 librados: starting objecter 2021-02-06T22:56:42.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 Processor -- start 2021-02-06T22:56:42.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 -- start start 2021-02-06T22:56:42.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 librados: setting wanted keys 2021-02-06T22:56:42.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.548+0000 7f8aa4e5c700 1 librados: calling monclient init 2021-02-06T22:56:42.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.549+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0123bc0 con 0x7f8aa012ce00 2021-02-06T22:56:42.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.549+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0129b40 con 0x7f8aa0092bf0 2021-02-06T22:56:42.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.549+0000 7f8aa4e5c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa0129de0 con 0x7f8aa008fa70 2021-02-06T22:56:42.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.549+0000 7f8a9e59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8aa008fa70 0x7f8aa0135770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32852/0 (socket says 172.21.15.51:32852) 2021-02-06T22:56:42.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.549+0000 7f8a9e59c700 1 -- 172.21.15.51:0/3961138455 learned_addr learned my addr 172.21.15.51:0/3961138455 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:42.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a9e59c700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.51:6790/0 conn(0x7f8aa008fa70 legacy=0x7f8aa0135770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter ms_handle_connect 0x7f8aa008fa70 2021-02-06T22:56:42.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a9ed9d700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.51:6789/0 conn(0x7f8aa012ce00 legacy=0x7f8aa013d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:42.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter ms_handle_connect 0x7f8aa012ce00 2021-02-06T22:56:42.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:42.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a9dd9b700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.106:6789/0 conn(0x7f8aa0092bf0 legacy=0x7f8aa012b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:42.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter ms_handle_connect 0x7f8aa0092bf0 2021-02-06T22:56:42.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:42.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570212013 0 0) 0x7f8aa0129de0 con 0x7f8aa008fa70 2021-02-06T22:56:42.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a7c004bd0 con 0x7f8aa008fa70 2021-02-06T22:56:42.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8412920 0 0) 0x7f8aa0123bc0 con 0x7f8aa012ce00 2021-02-06T22:56:42.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0129de0 con 0x7f8aa012ce00 2021-02-06T22:56:42.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568676003 0 0) 0x7f8aa0129b40 con 0x7f8aa0092bf0 2021-02-06T22:56:42.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.551+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0123bc0 con 0x7f8aa0092bf0 2021-02-06T22:56:42.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 447922789 0 0) 0x7f8a7c004bd0 con 0x7f8aa008fa70 2021-02-06T22:56:42.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8aa0129b40 con 0x7f8aa008fa70 2021-02-06T22:56:42.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a90001980 con 0x7f8aa008fa70 2021-02-06T22:56:42.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 674634280 0 0) 0x7f8aa0123bc0 con 0x7f8aa0092bf0 2021-02-06T22:56:42.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8a7c004bd0 con 0x7f8aa0092bf0 2021-02-06T22:56:42.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3007233111 0 0) 0x7f8aa0129de0 con 0x7f8aa012ce00 2021-02-06T22:56:42.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8aa0123bc0 con 0x7f8aa012ce00 2021-02-06T22:56:42.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a940018f0 con 0x7f8aa0092bf0 2021-02-06T22:56:42.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a98001f60 con 0x7f8aa012ce00 2021-02-06T22:56:42.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 63072140 0 0) 0x7f8aa0129b40 con 0x7f8aa008fa70 2021-02-06T22:56:42.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.106:6789/0 conn(0x7f8aa0092bf0 legacy=0x7f8aa012b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.51:6789/0 conn(0x7f8aa012ce00 legacy=0x7f8aa013d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0135e80 con 0x7f8aa008fa70 2021-02-06T22:56:42.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa0127c70 con 0x7f8aa008fa70 2021-02-06T22:56:42.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8aa4e5c700 10 client.4733.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:42.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa012bb60 con 0x7f8aa008fa70 2021-02-06T22:56:42.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8aa4e5c700 1 librados: init done 2021-02-06T22:56:42.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8a90004920 con 0x7f8aa008fa70 2021-02-06T22:56:42.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.552+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8a90004c30 con 0x7f8aa008fa70 2021-02-06T22:56:42.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f8a90004e10 con 0x7f8aa008fa70 2021-02-06T22:56:42.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a80004d60 con 0x7f8aa008fa70 2021-02-06T22:56:42.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f8a90039560 con 0x7f8aa008fa70 2021-02-06T22:56:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 10 client.4733.objecter ms_dispatch 0x7f8aa0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 3 client.4733.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 3 client.4733.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.553+0000 7f8a8e7fc700 20 client.4733.objecter dump_active .. 0 homeless 2021-02-06T22:56:42.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.555+0000 7f8a8e7fc700 10 client.4733.objecter ms_handle_connect 0x7f8a7c0308f0 2021-02-06T22:56:42.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.557+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f8a90012220 con 0x7f8aa008fa70 2021-02-06T22:56:42.806 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.807+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8a800059b0 con 0x7f8aa008fa70 2021-02-06T22:56:42.806 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.807+0000 7f8a8e7fc700 1 -- 172.21.15.51:0/3961138455 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f8a90012040 con 0x7f8aa008fa70 2021-02-06T22:56:42.807 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:42.808 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.808+0000 7f8aa4e5c700 10 librados: watch_flush enter 2021-02-06T22:56:42.808 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.808+0000 7f8aa4e5c700 10 librados: watch_flush exit 2021-02-06T22:56:42.808 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 20 client.4733.objecter shutdown clearing up homeless session... 2021-02-06T22:56:42.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 10 client.4733.objecter successfully canceled tick 2021-02-06T22:56:42.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.106:6812/33219 conn(0x7f8a7c0308f0 legacy=0x7f8a7c032db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 >> v1:172.21.15.51:6790/0 conn(0x7f8aa008fa70 legacy=0x7f8aa0135770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:42.809 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 shutdown_connections 2021-02-06T22:56:42.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 >> 172.21.15.51:0/3961138455 conn(0x7f8aa0096860 msgr2=0x7f8aa012c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:42.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 shutdown_connections 2021-02-06T22:56:42.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 -- 172.21.15.51:0/3961138455 wait complete. 2021-02-06T22:56:42.810 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:42.809+0000 7f8aa4e5c700 1 librados: shutdown 2021-02-06T22:56:42.819 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:45.820 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:45.955 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.955+0000 7f50a1cc7700 1 Processor -- start 2021-02-06T22:56:45.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f50a1cc7700 1 -- start start 2021-02-06T22:56:45.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f50a1cc7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0915d0 con 0x7f509c0928d0 2021-02-06T22:56:45.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f50a1cc7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c091ac0 con 0x7f509c0999a0 2021-02-06T22:56:45.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f50a1cc7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c091d60 con 0x7f509c0629e0 2021-02-06T22:56:45.956 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f509bfff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f509c0928d0 0x7f509c12fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60750/0 (socket says 172.21.15.51:60750) 2021-02-06T22:56:45.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f509affd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 0x7f509c090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32860/0 (socket says 172.21.15.51:32860) 2021-02-06T22:56:45.957 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.956+0000 7f509bfff700 1 -- 172.21.15.51:0/1152809741 learned_addr learned my addr 172.21.15.51:0/1152809741 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:45.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.958+0000 7f509affd700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 legacy=0x7f509c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.958+0000 7f509bfff700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.51:6789/0 conn(0x7f509c0928d0 legacy=0x7f509c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3461013253 0 0) 0x7f509c0915d0 con 0x7f509c0928d0 2021-02-06T22:56:45.959 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5088003230 con 0x7f509c0928d0 2021-02-06T22:56:45.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413085870 0 0) 0x7f509c091d60 con 0x7f509c0629e0 2021-02-06T22:56:45.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c0915d0 con 0x7f509c0629e0 2021-02-06T22:56:45.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509b7fe700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.106:6789/0 conn(0x7f509c0999a0 legacy=0x7f509c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2311120590 0 0) 0x7f509c0915d0 con 0x7f509c0629e0 2021-02-06T22:56:45.960 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.106:6789/0 conn(0x7f509c0999a0 legacy=0x7f509c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:45.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.51:6789/0 conn(0x7f509c0928d0 legacy=0x7f509c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:45.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c092000 con 0x7f509c0629e0 2021-02-06T22:56:45.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5090001930 con 0x7f509c0629e0 2021-02-06T22:56:45.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5090001c50 con 0x7f509c0629e0 2021-02-06T22:56:45.961 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.959+0000 7f509a7fc700 1 -- 172.21.15.51:0/1152809741 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5090004690 con 0x7f509c0629e0 2021-02-06T22:56:45.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 -- 172.21.15.51:0/1152809741 >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 legacy=0x7f509c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:45.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 -- 172.21.15.51:0/1152809741 shutdown_connections 2021-02-06T22:56:45.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 -- 172.21.15.51:0/1152809741 >> 172.21.15.51:0/1152809741 conn(0x7f509c096860 msgr2=0x7f509c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:45.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 -- 172.21.15.51:0/1152809741 shutdown_connections 2021-02-06T22:56:45.962 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 -- 172.21.15.51:0/1152809741 wait complete. 2021-02-06T22:56:45.965 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 librados: starting msgr at 2021-02-06T22:56:45.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.960+0000 7f50a1cc7700 1 librados: starting objecter 2021-02-06T22:56:45.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 Processor -- start 2021-02-06T22:56:45.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 -- start start 2021-02-06T22:56:45.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 librados: setting wanted keys 2021-02-06T22:56:45.966 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 librados: calling monclient init 2021-02-06T22:56:45.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c095160 con 0x7f509c0999a0 2021-02-06T22:56:45.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c11a5e0 con 0x7f509c0928d0 2021-02-06T22:56:45.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f50a1cc7700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c0674e0 con 0x7f509c0629e0 2021-02-06T22:56:45.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f509b7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 0x7f509c139c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32864/0 (socket says 172.21.15.51:32864) 2021-02-06T22:56:45.967 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.961+0000 7f509b7fe700 1 -- 172.21.15.51:0/953048900 learned_addr learned my addr 172.21.15.51:0/953048900 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:45.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f509b7fe700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 legacy=0x7f509c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f509bfff700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.51:6789/0 conn(0x7f509c0999a0 legacy=0x7f509c141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f50837fe700 10 client.?.objecter ms_handle_connect 0x7f509c0629e0 2021-02-06T22:56:45.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f50837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:45.968 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f50837fe700 10 client.?.objecter ms_handle_connect 0x7f509c0999a0 2021-02-06T22:56:45.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f50837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:45.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f50837fe700 10 client.?.objecter ms_handle_connect 0x7f509c0928d0 2021-02-06T22:56:45.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.963+0000 7f509affd700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.106:6789/0 conn(0x7f509c0928d0 legacy=0x7f509c1336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:45.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:45.969 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92683261 0 0) 0x7f509c0674e0 con 0x7f509c0629e0 2021-02-06T22:56:45.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c004bd0 con 0x7f509c0629e0 2021-02-06T22:56:45.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909957165 0 0) 0x7f509c095160 con 0x7f509c0999a0 2021-02-06T22:56:45.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c0674e0 con 0x7f509c0999a0 2021-02-06T22:56:45.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303989971 0 0) 0x7f509c11a5e0 con 0x7f509c0928d0 2021-02-06T22:56:45.970 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c095160 con 0x7f509c0928d0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3990172502 0 0) 0x7f507c004bd0 con 0x7f509c0629e0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f509c11a5e0 con 0x7f509c0629e0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f508c001bc0 con 0x7f509c0629e0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4019427776 0 0) 0x7f509c0674e0 con 0x7f509c0999a0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f507c004bd0 con 0x7f509c0999a0 2021-02-06T22:56:45.971 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5094001fb0 con 0x7f509c0999a0 2021-02-06T22:56:45.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4178878755 0 0) 0x7f509c11a5e0 con 0x7f509c0629e0 2021-02-06T22:56:45.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.106:6789/0 conn(0x7f509c0928d0 legacy=0x7f509c1336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:45.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.51:6789/0 conn(0x7f509c0999a0 legacy=0x7f509c141ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:45.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c133de0 con 0x7f509c0629e0 2021-02-06T22:56:45.972 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c119be0 con 0x7f509c0629e0 2021-02-06T22:56:45.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50a1cc7700 10 client.4739.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:45.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c1185a0 con 0x7f509c0629e0 2021-02-06T22:56:45.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50a1cc7700 1 librados: init done 2021-02-06T22:56:45.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f508c0022f0 con 0x7f509c0629e0 2021-02-06T22:56:45.973 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.964+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f508c002600 con 0x7f509c0629e0 2021-02-06T22:56:45.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f508c0027e0 con 0x7f509c0629e0 2021-02-06T22:56:45.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f508c039540 con 0x7f509c0629e0 2021-02-06T22:56:45.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 10 client.4739.objecter ms_dispatch 0x7f509c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:45.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 3 client.4739.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:45.974 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 3 client.4739.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:45.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50837fe700 20 client.4739.objecter dump_active .. 0 homeless 2021-02-06T22:56:45.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.965+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5074004d60 con 0x7f509c0629e0 2021-02-06T22:56:45.975 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.968+0000 7f50837fe700 10 client.4739.objecter ms_handle_connect 0x7f507c030500 2021-02-06T22:56:45.976 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:45.969+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f508c012430 con 0x7f509c0629e0 2021-02-06T22:56:46.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.213+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f50740059b0 con 0x7f509c0629e0 2021-02-06T22:56:46.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.214+0000 7f50837fe700 1 -- 172.21.15.51:0/953048900 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f508c012020 con 0x7f509c0629e0 2021-02-06T22:56:46.213 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:46.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 10 librados: watch_flush enter 2021-02-06T22:56:46.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 10 librados: watch_flush exit 2021-02-06T22:56:46.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 20 client.4739.objecter shutdown clearing up homeless session... 2021-02-06T22:56:46.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 10 client.4739.objecter successfully canceled tick 2021-02-06T22:56:46.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.106:6812/33219 conn(0x7f507c030500 legacy=0x7f507c0329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:46.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 >> v1:172.21.15.51:6790/0 conn(0x7f509c0629e0 legacy=0x7f509c139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:46.216 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 shutdown_connections 2021-02-06T22:56:46.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 >> 172.21.15.51:0/953048900 conn(0x7f509c096860 msgr2=0x7f509c064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:46.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 shutdown_connections 2021-02-06T22:56:46.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 -- 172.21.15.51:0/953048900 wait complete. 2021-02-06T22:56:46.217 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:46.215+0000 7f50a1cc7700 1 librados: shutdown 2021-02-06T22:56:46.226 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:49.227 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:49.362 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.363+0000 7fdaabbe3700 1 Processor -- start 2021-02-06T22:56:49.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.363+0000 7fdaabbe3700 1 -- start start 2021-02-06T22:56:49.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.363+0000 7fdaabbe3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4095270 con 0x7fdaa40999a0 2021-02-06T22:56:49.363 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.363+0000 7fdaabbe3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa40909e0 con 0x7fdaa41312e0 2021-02-06T22:56:49.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.363+0000 7fdaabbe3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4090c80 con 0x7fdaa4134df0 2021-02-06T22:56:49.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.364+0000 7fdaaa180700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fdaa4134df0 0x7fdaa41371e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32878/0 (socket says 172.21.15.51:32878) 2021-02-06T22:56:49.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.364+0000 7fdaa997f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 0x7fdaa40912e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60768/0 (socket says 172.21.15.51:60768) 2021-02-06T22:56:49.364 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.364+0000 7fdaaa180700 1 -- 172.21.15.51:0/839009342 learned_addr learned my addr 172.21.15.51:0/839009342 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:49.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaaa180700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.51:6790/0 conn(0x7fdaa4134df0 legacy=0x7fdaa41371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa997f700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 legacy=0x7fdaa40912e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095544065 0 0) 0x7fdaa4095270 con 0x7fdaa40999a0 2021-02-06T22:56:49.366 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa917e700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.106:6789/0 conn(0x7fdaa41312e0 legacy=0x7fdaa41336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8c003230 con 0x7fdaa40999a0 2021-02-06T22:56:49.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3558462689 0 0) 0x7fda8c003230 con 0x7fdaa40999a0 2021-02-06T22:56:49.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.51:6790/0 conn(0x7fdaa4134df0 legacy=0x7fdaa41371e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.367 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.106:6789/0 conn(0x7fdaa41312e0 legacy=0x7fdaa41336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4090f20 con 0x7fdaa40999a0 2021-02-06T22:56:49.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fda94001930 con 0x7fdaa40999a0 2021-02-06T22:56:49.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fda94001c40 con 0x7fdaa40999a0 2021-02-06T22:56:49.368 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.366+0000 7fdaa897d700 1 -- 172.21.15.51:0/839009342 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fda94004690 con 0x7fdaa40999a0 2021-02-06T22:56:49.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.367+0000 7fdaabbe3700 1 -- 172.21.15.51:0/839009342 >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 legacy=0x7fdaa40912e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.367+0000 7fdaabbe3700 1 -- 172.21.15.51:0/839009342 shutdown_connections 2021-02-06T22:56:49.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.367+0000 7fdaabbe3700 1 -- 172.21.15.51:0/839009342 >> 172.21.15.51:0/839009342 conn(0x7fdaa4096860 msgr2=0x7fdaa4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:49.372 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.367+0000 7fdaabbe3700 1 -- 172.21.15.51:0/839009342 shutdown_connections 2021-02-06T22:56:49.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.367+0000 7fdaabbe3700 1 -- 172.21.15.51:0/839009342 wait complete. 2021-02-06T22:56:49.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 librados: starting msgr at 2021-02-06T22:56:49.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 librados: starting objecter 2021-02-06T22:56:49.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 Processor -- start 2021-02-06T22:56:49.373 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 -- start start 2021-02-06T22:56:49.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 librados: setting wanted keys 2021-02-06T22:56:49.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 librados: calling monclient init 2021-02-06T22:56:49.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4067340 con 0x7fdaa40999a0 2021-02-06T22:56:49.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4067570 con 0x7fdaa4134df0 2021-02-06T22:56:49.374 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaabbe3700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4067810 con 0x7fdaa41312e0 2021-02-06T22:56:49.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaa997f700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 0x7fdaa413dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60772/0 (socket says 172.21.15.51:60772) 2021-02-06T22:56:49.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaa917e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fdaa41312e0 0x7fdaa4130710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32884/0 (socket says 172.21.15.51:32884) 2021-02-06T22:56:49.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.368+0000 7fdaa997f700 1 -- 172.21.15.51:0/4122603519 learned_addr learned my addr 172.21.15.51:0/4122603519 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:49.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fdaa997f700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 legacy=0x7fdaa413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.375 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter ms_handle_connect 0x7fdaa40999a0 2021-02-06T22:56:49.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fdaa917e700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.51:6790/0 conn(0x7fdaa41312e0 legacy=0x7fdaa4130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:49.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter ms_handle_connect 0x7fdaa41312e0 2021-02-06T22:56:49.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:49.376 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042059043 0 0) 0x7fdaa4067340 con 0x7fdaa40999a0 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda84004bd0 con 0x7fdaa40999a0 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter ms_handle_connect 0x7fdaa4134df0 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fdaaa180700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.106:6789/0 conn(0x7fdaa4134df0 legacy=0x7fdaa4146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1010901517 0 0) 0x7fda84004bd0 con 0x7fdaa40999a0 2021-02-06T22:56:49.377 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdaa4067340 con 0x7fdaa40999a0 2021-02-06T22:56:49.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fda940018f0 con 0x7fdaa40999a0 2021-02-06T22:56:49.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 275656749 0 0) 0x7fdaa4067340 con 0x7fdaa40999a0 2021-02-06T22:56:49.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.51:6790/0 conn(0x7fdaa41312e0 legacy=0x7fdaa4130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.106:6789/0 conn(0x7fdaa4134df0 legacy=0x7fdaa4146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.378 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4095060 con 0x7fdaa40999a0 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa4065630 con 0x7fdaa40999a0 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fda94004d80 con 0x7fdaa40999a0 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.371+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fda94005090 con 0x7fdaa40999a0 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fdaabbe3700 10 client.4767.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa4130e20 con 0x7fdaa40999a0 2021-02-06T22:56:49.379 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fdaabbe3700 1 librados: init done 2021-02-06T22:56:49.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fda94005270 con 0x7fdaa40999a0 2021-02-06T22:56:49.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fda940396f0 con 0x7fdaa40999a0 2021-02-06T22:56:49.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 10 client.4767.objecter ms_dispatch 0x7fdaa4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:49.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 3 client.4767.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:49.380 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 3 client.4767.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:49.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fda91ffb700 20 client.4767.objecter dump_active .. 0 homeless 2021-02-06T22:56:49.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.372+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa40981e0 con 0x7fdaa40999a0 2021-02-06T22:56:49.381 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.375+0000 7fda91ffb700 10 client.4767.objecter ms_handle_connect 0x7fda84030560 2021-02-06T22:56:49.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.377+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fda940126a0 con 0x7fdaa40999a0 2021-02-06T22:56:49.625 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.625+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdaa41310d0 con 0x7fdaa40999a0 2021-02-06T22:56:49.625 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.626+0000 7fda91ffb700 1 -- 172.21.15.51:0/4122603519 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7fda94012290 con 0x7fdaa40999a0 2021-02-06T22:56:49.625 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:49.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 10 librados: watch_flush enter 2021-02-06T22:56:49.627 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 10 librados: watch_flush exit 2021-02-06T22:56:49.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 20 client.4767.objecter shutdown clearing up homeless session... 2021-02-06T22:56:49.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 10 client.4767.objecter successfully canceled tick 2021-02-06T22:56:49.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.106:6812/33219 conn(0x7fda84030560 legacy=0x7fda84032a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.627+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 >> v1:172.21.15.51:6789/0 conn(0x7fdaa40999a0 legacy=0x7fdaa413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:49.628 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.628+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 shutdown_connections 2021-02-06T22:56:49.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.628+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 >> 172.21.15.51:0/4122603519 conn(0x7fdaa4096860 msgr2=0x7fdaa4097580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:49.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.628+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 shutdown_connections 2021-02-06T22:56:49.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.628+0000 7fdaabbe3700 1 -- 172.21.15.51:0/4122603519 wait complete. 2021-02-06T22:56:49.629 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:49.628+0000 7fdaabbe3700 1 librados: shutdown 2021-02-06T22:56:49.638 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:52.639 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:52.774 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.775+0000 7f9574048700 1 Processor -- start 2021-02-06T22:56:52.775 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9574048700 1 -- start start 2021-02-06T22:56:52.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9574048700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c0915d0 con 0x7f956c0629e0 2021-02-06T22:56:52.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9574048700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c091ac0 con 0x7f956c0928d0 2021-02-06T22:56:52.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9574048700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c091d60 con 0x7f956c0999a0 2021-02-06T22:56:52.776 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9571de4700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f956c0999a0 0x7f956c0907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32896/0 (socket says 172.21.15.51:32896) 2021-02-06T22:56:52.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f9571de4700 1 -- 172.21.15.51:0/3522419075 learned_addr learned my addr 172.21.15.51:0/3522419075 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:52.777 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.776+0000 7f95715e3700 1 --1- 172.21.15.51:0/3522419075 >> v1:172.21.15.51:6789/0 conn(0x7f956c0629e0 0x7f956c090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60790/0 (socket says 172.21.15.51:60790) 2021-02-06T22:56:52.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.778+0000 7f9571de4700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.51:6790/0 conn(0x7f956c0999a0 legacy=0x7f956c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f95715e3700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.51:6789/0 conn(0x7f956c0629e0 legacy=0x7f956c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.778 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868362962 0 0) 0x7f956c091d60 con 0x7f956c0999a0 2021-02-06T22:56:52.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9554003230 con 0x7f956c0999a0 2021-02-06T22:56:52.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056635203 0 0) 0x7f956c0915d0 con 0x7f956c0629e0 2021-02-06T22:56:52.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f956c091d60 con 0x7f956c0629e0 2021-02-06T22:56:52.780 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f95725e5700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.106:6789/0 conn(0x7f956c0928d0 legacy=0x7f956c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2753381729 0 0) 0x7f9554003230 con 0x7f956c0999a0 2021-02-06T22:56:52.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.106:6789/0 conn(0x7f956c0928d0 legacy=0x7f956c12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:52.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.51:6789/0 conn(0x7f956c0629e0 legacy=0x7f956c090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:52.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c092000 con 0x7f956c0999a0 2021-02-06T22:56:52.781 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f95680019f0 con 0x7f956c0999a0 2021-02-06T22:56:52.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f9568001be0 con 0x7f956c0999a0 2021-02-06T22:56:52.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.779+0000 7f9570de2700 1 -- 172.21.15.51:0/3522419075 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9568004750 con 0x7f956c0999a0 2021-02-06T22:56:52.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.780+0000 7f9574048700 1 -- 172.21.15.51:0/3522419075 >> v1:172.21.15.51:6790/0 conn(0x7f956c0999a0 legacy=0x7f956c0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:52.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.780+0000 7f9574048700 1 -- 172.21.15.51:0/3522419075 shutdown_connections 2021-02-06T22:56:52.782 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.780+0000 7f9574048700 1 -- 172.21.15.51:0/3522419075 >> 172.21.15.51:0/3522419075 conn(0x7f956c096860 msgr2=0x7f956c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:52.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.780+0000 7f9574048700 1 -- 172.21.15.51:0/3522419075 shutdown_connections 2021-02-06T22:56:52.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.780+0000 7f9574048700 1 -- 172.21.15.51:0/3522419075 wait complete. 2021-02-06T22:56:52.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 librados: starting msgr at 2021-02-06T22:56:52.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 librados: starting objecter 2021-02-06T22:56:52.783 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 Processor -- start 2021-02-06T22:56:52.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 -- start start 2021-02-06T22:56:52.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 librados: setting wanted keys 2021-02-06T22:56:52.784 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 librados: calling monclient init 2021-02-06T22:56:52.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c12de20 con 0x7f956c0999a0 2021-02-06T22:56:52.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c12fa40 con 0x7f956c0928d0 2021-02-06T22:56:52.787 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9574048700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956c12fce0 con 0x7f956c0629e0 2021-02-06T22:56:52.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9571de4700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f956c0629e0 0x7f956c12d000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32904/0 (socket says 172.21.15.51:32904) 2021-02-06T22:56:52.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f9571de4700 1 -- 172.21.15.51:0/2108014525 learned_addr learned my addr 172.21.15.51:0/2108014525 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:52.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.781+0000 7f95725e5700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f956c0999a0 0x7f956c13fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60796/0 (socket says 172.21.15.51:60796) 2021-02-06T22:56:52.788 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f95725e5700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.51:6789/0 conn(0x7f956c0999a0 legacy=0x7f956c13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f9559ffb700 10 client.?.objecter ms_handle_connect 0x7f956c0999a0 2021-02-06T22:56:52.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f9571de4700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.51:6790/0 conn(0x7f956c0629e0 legacy=0x7f956c12d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f9559ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:52.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f9559ffb700 10 client.?.objecter ms_handle_connect 0x7f956c0629e0 2021-02-06T22:56:52.789 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.783+0000 7f9559ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:52.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341347464 0 0) 0x7f956c12de20 con 0x7f956c0999a0 2021-02-06T22:56:52.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c004bd0 con 0x7f956c0999a0 2021-02-06T22:56:52.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f95715e3700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.106:6789/0 conn(0x7f956c0928d0 legacy=0x7f956c12d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:52.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 10 client.?.objecter ms_handle_connect 0x7f956c0928d0 2021-02-06T22:56:52.790 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:52.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128123942 0 0) 0x7f956c12fce0 con 0x7f956c0629e0 2021-02-06T22:56:52.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f956c12de20 con 0x7f956c0629e0 2021-02-06T22:56:52.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302813677 0 0) 0x7f956c12fa40 con 0x7f956c0928d0 2021-02-06T22:56:52.791 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f956c12fce0 con 0x7f956c0928d0 2021-02-06T22:56:52.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1134588114 0 0) 0x7f954c004bd0 con 0x7f956c0999a0 2021-02-06T22:56:52.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f956c12fa40 con 0x7f956c0999a0 2021-02-06T22:56:52.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 169042278 0 0) 0x7f956c12de20 con 0x7f956c0629e0 2021-02-06T22:56:52.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f954c004bd0 con 0x7f956c0629e0 2021-02-06T22:56:52.792 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9564001f20 con 0x7f956c0999a0 2021-02-06T22:56:52.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f95680019b0 con 0x7f956c0629e0 2021-02-06T22:56:52.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3918299967 0 0) 0x7f956c12fa40 con 0x7f956c0999a0 2021-02-06T22:56:52.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.51:6790/0 conn(0x7f956c0629e0 legacy=0x7f956c12d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:52.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.106:6789/0 conn(0x7f956c0928d0 legacy=0x7f956c12d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:52.793 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c095160 con 0x7f956c0999a0 2021-02-06T22:56:52.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956c094900 con 0x7f956c0999a0 2021-02-06T22:56:52.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f95640024f0 con 0x7f956c0999a0 2021-02-06T22:56:52.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f9564002800 con 0x7f956c0999a0 2021-02-06T22:56:52.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9574048700 10 client.4773.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:52.794 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.784+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f956c094120 con 0x7f956c0999a0 2021-02-06T22:56:52.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.785+0000 7f9574048700 1 librados: init done 2021-02-06T22:56:52.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.785+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f95640029e0 con 0x7f956c0999a0 2021-02-06T22:56:52.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.785+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956c0581b0 con 0x7f956c0999a0 2021-02-06T22:56:52.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.786+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f9564039610 con 0x7f956c0999a0 2021-02-06T22:56:52.795 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.786+0000 7f9559ffb700 10 client.4773.objecter ms_dispatch 0x7f956c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:52.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.786+0000 7f9559ffb700 3 client.4773.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:52.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.786+0000 7f9559ffb700 3 client.4773.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:52.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.786+0000 7f9559ffb700 20 client.4773.objecter dump_active .. 0 homeless 2021-02-06T22:56:52.796 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.788+0000 7f9559ffb700 10 client.4773.objecter ms_handle_connect 0x7f954c030500 2021-02-06T22:56:52.797 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:52.789+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f9564012270 con 0x7f956c0999a0 2021-02-06T22:56:53.038 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.039+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f956c0923c0 con 0x7f956c0999a0 2021-02-06T22:56:53.039 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.039+0000 7f9559ffb700 1 -- 172.21.15.51:0/2108014525 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f956400fe60 con 0x7f956c0999a0 2021-02-06T22:56:53.039 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:53.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.040+0000 7f9574048700 10 librados: watch_flush enter 2021-02-06T22:56:53.040 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.040+0000 7f9574048700 10 librados: watch_flush exit 2021-02-06T22:56:53.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.040+0000 7f9574048700 20 client.4773.objecter shutdown clearing up homeless session... 2021-02-06T22:56:53.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.040+0000 7f9574048700 10 client.4773.objecter successfully canceled tick 2021-02-06T22:56:53.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.040+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.106:6812/33219 conn(0x7f954c030500 legacy=0x7f954c0329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:53.041 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 >> v1:172.21.15.51:6789/0 conn(0x7f956c0999a0 legacy=0x7f956c13fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:53.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 shutdown_connections 2021-02-06T22:56:53.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 >> 172.21.15.51:0/2108014525 conn(0x7f956c096860 msgr2=0x7f956c0979f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:53.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 shutdown_connections 2021-02-06T22:56:53.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 -- 172.21.15.51:0/2108014525 wait complete. 2021-02-06T22:56:53.042 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:53.041+0000 7f9574048700 1 librados: shutdown 2021-02-06T22:56:53.051 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:56.052 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:56.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a28824700 1 Processor -- start 2021-02-06T22:56:56.187 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a28824700 1 -- start start 2021-02-06T22:56:56.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a28824700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a24095440 con 0x7f0a2408fa70 2021-02-06T22:56:56.188 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a28824700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a240907b0 con 0x7f0a2412ce00 2021-02-06T22:56:56.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a28824700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a24091010 con 0x7f0a24092bf0 2021-02-06T22:56:56.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a21d9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0a24092bf0 0x7f0a240930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32916/0 (socket says 172.21.15.51:32916) 2021-02-06T22:56:56.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a2259c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 0x7f0a240921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60804/0 (socket says 172.21.15.51:60804) 2021-02-06T22:56:56.189 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.188+0000 7f0a21d9b700 1 -- 172.21.15.51:0/1378821709 learned_addr learned my addr 172.21.15.51:0/1378821709 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:56.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2259c700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 legacy=0x7f0a240921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.191 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a21d9b700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.51:6790/0 conn(0x7f0a24092bf0 legacy=0x7f0a240930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a22d9d700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.106:6789/0 conn(0x7f0a2412ce00 legacy=0x7f0a2412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718456729 0 0) 0x7f0a24095440 con 0x7f0a2408fa70 2021-02-06T22:56:56.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a08003230 con 0x7f0a2408fa70 2021-02-06T22:56:56.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321029145 0 0) 0x7f0a24091010 con 0x7f0a24092bf0 2021-02-06T22:56:56.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a24095440 con 0x7f0a24092bf0 2021-02-06T22:56:56.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350947103 0 0) 0x7f0a240907b0 con 0x7f0a2412ce00 2021-02-06T22:56:56.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a24091010 con 0x7f0a2412ce00 2021-02-06T22:56:56.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 950035637 0 0) 0x7f0a24095440 con 0x7f0a24092bf0 2021-02-06T22:56:56.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.106:6789/0 conn(0x7f0a2412ce00 legacy=0x7f0a2412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 legacy=0x7f0a240921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240912b0 con 0x7f0a24092bf0 2021-02-06T22:56:56.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.191+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a180019f0 con 0x7f0a24092bf0 2021-02-06T22:56:56.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a18001c50 con 0x7f0a24092bf0 2021-02-06T22:56:56.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a2159a700 1 -- 172.21.15.51:0/1378821709 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a18004750 con 0x7f0a24092bf0 2021-02-06T22:56:56.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a28824700 1 -- 172.21.15.51:0/1378821709 >> v1:172.21.15.51:6790/0 conn(0x7f0a24092bf0 legacy=0x7f0a240930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a28824700 1 -- 172.21.15.51:0/1378821709 shutdown_connections 2021-02-06T22:56:56.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a28824700 1 -- 172.21.15.51:0/1378821709 >> 172.21.15.51:0/1378821709 conn(0x7f0a24096860 msgr2=0x7f0a24099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:56.195 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a28824700 1 -- 172.21.15.51:0/1378821709 shutdown_connections 2021-02-06T22:56:56.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.192+0000 7f0a28824700 1 -- 172.21.15.51:0/1378821709 wait complete. 2021-02-06T22:56:56.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 librados: starting msgr at 2021-02-06T22:56:56.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 librados: starting objecter 2021-02-06T22:56:56.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 Processor -- start 2021-02-06T22:56:56.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 -- start start 2021-02-06T22:56:56.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 librados: setting wanted keys 2021-02-06T22:56:56.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 librados: calling monclient init 2021-02-06T22:56:56.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a24133e50 con 0x7f0a2408fa70 2021-02-06T22:56:56.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2412bca0 con 0x7f0a24092bf0 2021-02-06T22:56:56.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.193+0000 7f0a28824700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2412bf40 con 0x7f0a2412ce00 2021-02-06T22:56:56.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.194+0000 7f0a2259c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 0x7f0a2413a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60810/0 (socket says 172.21.15.51:60810) 2021-02-06T22:56:56.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.194+0000 7f0a2259c700 1 -- 172.21.15.51:0/359146673 learned_addr learned my addr 172.21.15.51:0/359146673 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:56.201 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.194+0000 7f0a22d9d700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0a2412ce00 0x7f0a24142390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32924/0 (socket says 172.21.15.51:32924) 2021-02-06T22:56:56.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a22d9d700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.51:6790/0 conn(0x7f0a2412ce00 legacy=0x7f0a24142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a2259c700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 legacy=0x7f0a2413a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter ms_handle_connect 0x7f0a2412ce00 2021-02-06T22:56:56.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:56.202 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter ms_handle_connect 0x7f0a2408fa70 2021-02-06T22:56:56.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:56.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348296344 0 0) 0x7f0a2412bf40 con 0x7f0a2412ce00 2021-02-06T22:56:56.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00004bd0 con 0x7f0a2412ce00 2021-02-06T22:56:56.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604184163 0 0) 0x7f0a24133e50 con 0x7f0a2408fa70 2021-02-06T22:56:56.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a2412bf40 con 0x7f0a2408fa70 2021-02-06T22:56:56.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter ms_handle_connect 0x7f0a24092bf0 2021-02-06T22:56:56.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:56.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a21d9b700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.106:6789/0 conn(0x7f0a24092bf0 legacy=0x7f0a2413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:56.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2302492025 0 0) 0x7f0a00004bd0 con 0x7f0a2412ce00 2021-02-06T22:56:56.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a24133e50 con 0x7f0a2412ce00 2021-02-06T22:56:56.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a1c001f60 con 0x7f0a2412ce00 2021-02-06T22:56:56.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1838131434 0 0) 0x7f0a2412bf40 con 0x7f0a2408fa70 2021-02-06T22:56:56.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a00004bd0 con 0x7f0a2408fa70 2021-02-06T22:56:56.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a14001ce0 con 0x7f0a2408fa70 2021-02-06T22:56:56.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930279283 0 0) 0x7f0a2412bca0 con 0x7f0a24092bf0 2021-02-06T22:56:56.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a2412bf40 con 0x7f0a24092bf0 2021-02-06T22:56:56.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3954359620 0 0) 0x7f0a24133e50 con 0x7f0a2412ce00 2021-02-06T22:56:56.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.106:6789/0 conn(0x7f0a24092bf0 legacy=0x7f0a2413ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.51:6789/0 conn(0x7f0a2408fa70 legacy=0x7f0a2413a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.196+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2412c1e0 con 0x7f0a2412ce00 2021-02-06T22:56:56.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24132de0 con 0x7f0a2412ce00 2021-02-06T22:56:56.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a28824700 10 client.4751.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:56.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2412ad70 con 0x7f0a2412ce00 2021-02-06T22:56:56.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a28824700 1 librados: init done 2021-02-06T22:56:56.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0a1c0025f0 con 0x7f0a2412ce00 2021-02-06T22:56:56.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0a1c002900 con 0x7f0a2412ce00 2021-02-06T22:56:56.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0a1c002a60 con 0x7f0a2412ce00 2021-02-06T22:56:56.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0a1c039750 con 0x7f0a2412ce00 2021-02-06T22:56:56.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 10 client.4751.objecter ms_dispatch 0x7f0a24001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:56.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 3 client.4751.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:56.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 3 client.4751.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:56.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a127fc700 20 client.4751.objecter dump_active .. 0 homeless 2021-02-06T22:56:56.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.197+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04004d60 con 0x7f0a2412ce00 2021-02-06T22:56:56.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.200+0000 7f0a127fc700 10 client.4751.objecter ms_handle_connect 0x7f0a000307b0 2021-02-06T22:56:56.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.202+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0a1c012610 con 0x7f0a2412ce00 2021-02-06T22:56:56.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.449+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0a040059b0 con 0x7f0a2412ce00 2021-02-06T22:56:56.448 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.449+0000 7f0a127fc700 1 -- 172.21.15.51:0/359146673 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0a1c012200 con 0x7f0a2412ce00 2021-02-06T22:56:56.449 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:56.450 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 10 librados: watch_flush enter 2021-02-06T22:56:56.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 10 librados: watch_flush exit 2021-02-06T22:56:56.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 20 client.4751.objecter shutdown clearing up homeless session... 2021-02-06T22:56:56.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 10 client.4751.objecter successfully canceled tick 2021-02-06T22:56:56.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.106:6812/33219 conn(0x7f0a000307b0 legacy=0x7f0a00032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.451 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 >> v1:172.21.15.51:6790/0 conn(0x7f0a2412ce00 legacy=0x7f0a24142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:56.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 shutdown_connections 2021-02-06T22:56:56.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 >> 172.21.15.51:0/359146673 conn(0x7f0a24096860 msgr2=0x7f0a24093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:56.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 shutdown_connections 2021-02-06T22:56:56.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 -- 172.21.15.51:0/359146673 wait complete. 2021-02-06T22:56:56.452 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:56.451+0000 7f0a28824700 1 librados: shutdown 2021-02-06T22:56:56.462 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:56:59.463 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:56:59.597 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.597+0000 7f3930489700 1 Processor -- start 2021-02-06T22:56:59.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.597+0000 7f3930489700 1 -- start start 2021-02-06T22:56:59.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f3930489700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392808ef70 con 0x7f39280908f0 2021-02-06T22:56:59.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f3930489700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392808f440 con 0x7f3928062530 2021-02-06T22:56:59.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f3930489700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280620b0 con 0x7f3928090d50 2021-02-06T22:56:59.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f392ea26700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3928090d50 0x7f39281331e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32932/0 (socket says 172.21.15.51:32932) 2021-02-06T22:56:59.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f392ea26700 1 -- 172.21.15.51:0/1082039099 learned_addr learned my addr 172.21.15.51:0/1082039099 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:59.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.598+0000 7f392da24700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f39280908f0 0x7f392812fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60818/0 (socket says 172.21.15.51:60818) 2021-02-06T22:56:59.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392da24700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.51:6789/0 conn(0x7f39280908f0 legacy=0x7f392812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392ea26700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.51:6790/0 conn(0x7f3928090d50 legacy=0x7f39281331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186348606 0 0) 0x7f392808ef70 con 0x7f39280908f0 2021-02-06T22:56:59.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3910003230 con 0x7f39280908f0 2021-02-06T22:56:59.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662924676 0 0) 0x7f39280620b0 con 0x7f3928090d50 2021-02-06T22:56:59.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392808ef70 con 0x7f3928090d50 2021-02-06T22:56:59.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.600+0000 7f392e225700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.106:6789/0 conn(0x7f3928062530 legacy=0x7f39280619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142197841 0 0) 0x7f392808f440 con 0x7f3928062530 2021-02-06T22:56:59.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39280620b0 con 0x7f3928062530 2021-02-06T22:56:59.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2900011648 0 0) 0x7f3910003230 con 0x7f39280908f0 2021-02-06T22:56:59.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.51:6790/0 conn(0x7f3928090d50 legacy=0x7f39281331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.106:6789/0 conn(0x7f3928062530 legacy=0x7f39280619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928096470 con 0x7f39280908f0 2021-02-06T22:56:59.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f39240019f0 con 0x7f39280908f0 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3924001c10 con 0x7f39280908f0 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f392d223700 1 -- 172.21.15.51:0/1082039099 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3924004690 con 0x7f39280908f0 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f3930489700 1 -- 172.21.15.51:0/1082039099 >> v1:172.21.15.51:6789/0 conn(0x7f39280908f0 legacy=0x7f392812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f3930489700 1 -- 172.21.15.51:0/1082039099 shutdown_connections 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f3930489700 1 -- 172.21.15.51:0/1082039099 >> 172.21.15.51:0/1082039099 conn(0x7f392809b010 msgr2=0x7f3928096e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:59.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f3930489700 1 -- 172.21.15.51:0/1082039099 shutdown_connections 2021-02-06T22:56:59.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.601+0000 7f3930489700 1 -- 172.21.15.51:0/1082039099 wait complete. 2021-02-06T22:56:59.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 librados: starting msgr at 2021-02-06T22:56:59.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 librados: starting objecter 2021-02-06T22:56:59.609 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 Processor -- start 2021-02-06T22:56:59.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 -- start start 2021-02-06T22:56:59.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 librados: setting wanted keys 2021-02-06T22:56:59.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.602+0000 7f3930489700 1 librados: calling monclient init 2021-02-06T22:56:59.610 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.603+0000 7f3930489700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3928124be0 con 0x7f3928062530 2021-02-06T22:56:59.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.603+0000 7f3930489700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3928123fe0 con 0x7f39280908f0 2021-02-06T22:56:59.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.603+0000 7f3930489700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3928128df0 con 0x7f3928090d50 2021-02-06T22:56:59.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.603+0000 7f392e225700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3928062530 0x7f392812a0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60824/0 (socket says 172.21.15.51:60824) 2021-02-06T22:56:59.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.603+0000 7f392e225700 1 -- 172.21.15.51:0/2683263317 learned_addr learned my addr 172.21.15.51:0/2683263317 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:56:59.611 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f392e225700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.51:6789/0 conn(0x7f3928062530 legacy=0x7f392812a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f392ea26700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.51:6790/0 conn(0x7f3928090d50 legacy=0x7f3928142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter ms_handle_connect 0x7f3928062530 2021-02-06T22:56:59.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:59.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter ms_handle_connect 0x7f3928090d50 2021-02-06T22:56:59.612 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:59.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f392da24700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.106:6789/0 conn(0x7f39280908f0 legacy=0x7f392813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:56:59.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter ms_handle_connect 0x7f39280908f0 2021-02-06T22:56:59.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:56:59.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340985993 0 0) 0x7f3928124be0 con 0x7f3928062530 2021-02-06T22:56:59.613 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3908004bd0 con 0x7f3928062530 2021-02-06T22:56:59.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808483652 0 0) 0x7f3928128df0 con 0x7f3928090d50 2021-02-06T22:56:59.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928124be0 con 0x7f3928090d50 2021-02-06T22:56:59.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923865297 0 0) 0x7f3928123fe0 con 0x7f39280908f0 2021-02-06T22:56:59.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3928128df0 con 0x7f39280908f0 2021-02-06T22:56:59.614 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 976520549 0 0) 0x7f3908004bd0 con 0x7f3928062530 2021-02-06T22:56:59.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3928123fe0 con 0x7f3928062530 2021-02-06T22:56:59.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.605+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3918001c70 con 0x7f3928062530 2021-02-06T22:56:59.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 7721057 0 0) 0x7f3928128df0 con 0x7f39280908f0 2021-02-06T22:56:59.615 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3908004bd0 con 0x7f39280908f0 2021-02-06T22:56:59.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4030703131 0 0) 0x7f3928124be0 con 0x7f3928090d50 2021-02-06T22:56:59.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3928128df0 con 0x7f3928090d50 2021-02-06T22:56:59.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3924004690 con 0x7f39280908f0 2021-02-06T22:56:59.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3920002030 con 0x7f3928090d50 2021-02-06T22:56:59.616 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1748235249 0 0) 0x7f3928123fe0 con 0x7f3928062530 2021-02-06T22:56:59.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.51:6790/0 conn(0x7f3928090d50 legacy=0x7f3928142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.106:6789/0 conn(0x7f39280908f0 legacy=0x7f392813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928129090 con 0x7f3928062530 2021-02-06T22:56:59.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39281250f0 con 0x7f3928062530 2021-02-06T22:56:59.617 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f3930489700 10 client.4785.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:56:59.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3928129c60 con 0x7f3928062530 2021-02-06T22:56:59.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f3930489700 1 librados: init done 2021-02-06T22:56:59.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3918002350 con 0x7f3928062530 2021-02-06T22:56:59.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3918002660 con 0x7f3928062530 2021-02-06T22:56:59.618 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.606+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3918002840 con 0x7f3928062530 2021-02-06T22:56:59.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c004d60 con 0x7f3928062530 2021-02-06T22:56:59.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3918039660 con 0x7f3928062530 2021-02-06T22:56:59.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f39167fc700 10 client.4785.objecter ms_dispatch 0x7f3928001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:56:59.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f39167fc700 3 client.4785.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:56:59.619 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f39167fc700 3 client.4785.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:56:59.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.607+0000 7f39167fc700 20 client.4785.objecter dump_active .. 0 homeless 2021-02-06T22:56:59.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.609+0000 7f39167fc700 10 client.4785.objecter ms_handle_connect 0x7f39080309f0 2021-02-06T22:56:59.620 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.611+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f3918012270 con 0x7f3928062530 2021-02-06T22:56:59.858 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.858+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f390c0059b0 con 0x7f3928062530 2021-02-06T22:56:59.859 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.858+0000 7f39167fc700 1 -- 172.21.15.51:0/2683263317 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f3918012090 con 0x7f3928062530 2021-02-06T22:56:59.859 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:56:59.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.859+0000 7f3930489700 10 librados: watch_flush enter 2021-02-06T22:56:59.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.859+0000 7f3930489700 10 librados: watch_flush exit 2021-02-06T22:56:59.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 20 client.4785.objecter shutdown clearing up homeless session... 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 10 client.4785.objecter successfully canceled tick 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.106:6812/33219 conn(0x7f39080309f0 legacy=0x7f3908032eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 >> v1:172.21.15.51:6789/0 conn(0x7f3928062530 legacy=0x7f392812a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 shutdown_connections 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 >> 172.21.15.51:0/2683263317 conn(0x7f392809b010 msgr2=0x7f392812db30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:56:59.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 shutdown_connections 2021-02-06T22:56:59.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 -- 172.21.15.51:0/2683263317 wait complete. 2021-02-06T22:56:59.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:56:59.860+0000 7f3930489700 1 librados: shutdown 2021-02-06T22:56:59.871 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:02.872 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:03.006 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.006+0000 7f82b8341700 1 Processor -- start 2021-02-06T22:57:03.006 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.006+0000 7f82b8341700 1 -- start start 2021-02-06T22:57:03.007 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b8341700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b00915d0 con 0x7f82b00928d0 2021-02-06T22:57:03.007 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b8341700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0091ac0 con 0x7f82b00629e0 2021-02-06T22:57:03.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b8341700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0091d60 con 0x7f82b00999a0 2021-02-06T22:57:03.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b68de700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f82b00928d0 0x7f82b012fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60836/0 (socket says 172.21.15.51:60836) 2021-02-06T22:57:03.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b68de700 1 -- 172.21.15.51:0/2778489649 learned_addr learned my addr 172.21.15.51:0/2778489649 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:03.008 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.007+0000 7f82b60dd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f82b00999a0 0x7f82b00907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32942/0 (socket says 172.21.15.51:32942) 2021-02-06T22:57:03.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b60dd700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.51:6790/0 conn(0x7f82b00999a0 legacy=0x7f82b00907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.011 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b68de700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.51:6789/0 conn(0x7f82b00928d0 legacy=0x7f82b012fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b58dc700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.106:6789/0 conn(0x7f82b00629e0 legacy=0x7f82b0090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983151071 0 0) 0x7f82b0091d60 con 0x7f82b00999a0 2021-02-06T22:57:03.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8298003230 con 0x7f82b00999a0 2021-02-06T22:57:03.012 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153653656 0 0) 0x7f82b00915d0 con 0x7f82b00928d0 2021-02-06T22:57:03.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b0091d60 con 0x7f82b00928d0 2021-02-06T22:57:03.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110378030 0 0) 0x7f82b0091ac0 con 0x7f82b00629e0 2021-02-06T22:57:03.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.009+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b00915d0 con 0x7f82b00629e0 2021-02-06T22:57:03.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1616603208 0 0) 0x7f8298003230 con 0x7f82b00999a0 2021-02-06T22:57:03.013 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.106:6789/0 conn(0x7f82b00629e0 legacy=0x7f82b0090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.51:6789/0 conn(0x7f82b00928d0 legacy=0x7f82b012fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0092000 con 0x7f82b00999a0 2021-02-06T22:57:03.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82a00019f0 con 0x7f82b00999a0 2021-02-06T22:57:03.014 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f82a0001c20 con 0x7f82b00999a0 2021-02-06T22:57:03.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b50db700 1 -- 172.21.15.51:0/2778489649 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82a0004690 con 0x7f82b00999a0 2021-02-06T22:57:03.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b8341700 1 -- 172.21.15.51:0/2778489649 >> v1:172.21.15.51:6790/0 conn(0x7f82b00999a0 legacy=0x7f82b00907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b8341700 1 -- 172.21.15.51:0/2778489649 shutdown_connections 2021-02-06T22:57:03.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b8341700 1 -- 172.21.15.51:0/2778489649 >> 172.21.15.51:0/2778489649 conn(0x7f82b0096860 msgr2=0x7f82b0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:03.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b8341700 1 -- 172.21.15.51:0/2778489649 shutdown_connections 2021-02-06T22:57:03.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.010+0000 7f82b8341700 1 -- 172.21.15.51:0/2778489649 wait complete. 2021-02-06T22:57:03.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 librados: starting msgr at 2021-02-06T22:57:03.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 librados: starting objecter 2021-02-06T22:57:03.016 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 Processor -- start 2021-02-06T22:57:03.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 -- start start 2021-02-06T22:57:03.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 librados: setting wanted keys 2021-02-06T22:57:03.017 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.011+0000 7f82b8341700 1 librados: calling monclient init 2021-02-06T22:57:03.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.012+0000 7f82b8341700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b013a470 con 0x7f82b00928d0 2021-02-06T22:57:03.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.012+0000 7f82b8341700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b0117210 con 0x7f82b00999a0 2021-02-06T22:57:03.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.012+0000 7f82b8341700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b01174b0 con 0x7f82b00629e0 2021-02-06T22:57:03.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.012+0000 7f82b60dd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f82b00629e0 0x7f82b01395a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32948/0 (socket says 172.21.15.51:32948) 2021-02-06T22:57:03.021 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.012+0000 7f82b60dd700 1 -- 172.21.15.51:0/1867742276 learned_addr learned my addr 172.21.15.51:0/1867742276 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:03.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f82b60dd700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.51:6790/0 conn(0x7f82b00629e0 legacy=0x7f82b01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter ms_handle_connect 0x7f82b00629e0 2021-02-06T22:57:03.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f82b58dc700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.51:6789/0 conn(0x7f82b00928d0 legacy=0x7f82b0125cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:03.022 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter ms_handle_connect 0x7f82b00928d0 2021-02-06T22:57:03.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:03.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter ms_handle_connect 0x7f82b00999a0 2021-02-06T22:57:03.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f82b68de700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.106:6789/0 conn(0x7f82b00999a0 legacy=0x7f82b01418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:03.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:03.023 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990271615 0 0) 0x7f82b01174b0 con 0x7f82b00629e0 2021-02-06T22:57:03.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8290004bd0 con 0x7f82b00629e0 2021-02-06T22:57:03.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092712686 0 0) 0x7f82b013a470 con 0x7f82b00928d0 2021-02-06T22:57:03.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b01174b0 con 0x7f82b00928d0 2021-02-06T22:57:03.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093922308 0 0) 0x7f82b0117210 con 0x7f82b00999a0 2021-02-06T22:57:03.024 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b013a470 con 0x7f82b00999a0 2021-02-06T22:57:03.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1523298414 0 0) 0x7f8290004bd0 con 0x7f82b00629e0 2021-02-06T22:57:03.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82b0117210 con 0x7f82b00629e0 2021-02-06T22:57:03.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82a0004690 con 0x7f82b00629e0 2021-02-06T22:57:03.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 623185026 0 0) 0x7f82b01174b0 con 0x7f82b00928d0 2021-02-06T22:57:03.025 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8290004bd0 con 0x7f82b00928d0 2021-02-06T22:57:03.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82ac001bd0 con 0x7f82b00928d0 2021-02-06T22:57:03.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 339812193 0 0) 0x7f82b013a470 con 0x7f82b00999a0 2021-02-06T22:57:03.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f82b01174b0 con 0x7f82b00999a0 2021-02-06T22:57:03.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.014+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82a8001920 con 0x7f82b00999a0 2021-02-06T22:57:03.026 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3918181385 0 0) 0x7f82b0117210 con 0x7f82b00629e0 2021-02-06T22:57:03.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.106:6789/0 conn(0x7f82b00999a0 legacy=0x7f82b01418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.51:6789/0 conn(0x7f82b00928d0 legacy=0x7f82b0125cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0117750 con 0x7f82b00629e0 2021-02-06T22:57:03.027 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b01155e0 con 0x7f82b00629e0 2021-02-06T22:57:03.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f82b8341700 10 client.4763.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:03.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b01263e0 con 0x7f82b00629e0 2021-02-06T22:57:03.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f82b8341700 1 librados: init done 2021-02-06T22:57:03.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f82a0001560 con 0x7f82b00629e0 2021-02-06T22:57:03.028 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f82a0004fb0 con 0x7f82b00629e0 2021-02-06T22:57:03.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.015+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f82a000d770 con 0x7f82b00629e0 2021-02-06T22:57:03.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f82a00396e0 con 0x7f82b00629e0 2021-02-06T22:57:03.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f829e7fc700 10 client.4763.objecter ms_dispatch 0x7f82b0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:03.029 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f829e7fc700 3 client.4763.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:03.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f829e7fc700 3 client.4763.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:03.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8294004d60 con 0x7f82b00629e0 2021-02-06T22:57:03.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.016+0000 7f829e7fc700 20 client.4763.objecter dump_active .. 0 homeless 2021-02-06T22:57:03.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.018+0000 7f829e7fc700 10 client.4763.objecter ms_handle_connect 0x7f82900308a0 2021-02-06T22:57:03.030 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.020+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f82a00125d0 con 0x7f82b00629e0 2021-02-06T22:57:03.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.269+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f82940059b0 con 0x7f82b00629e0 2021-02-06T22:57:03.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.269+0000 7f829e7fc700 1 -- 172.21.15.51:0/1867742276 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f82a00121c0 con 0x7f82b00629e0 2021-02-06T22:57:03.270 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:03.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 10 librados: watch_flush enter 2021-02-06T22:57:03.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 10 librados: watch_flush exit 2021-02-06T22:57:03.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 20 client.4763.objecter shutdown clearing up homeless session... 2021-02-06T22:57:03.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 10 client.4763.objecter successfully canceled tick 2021-02-06T22:57:03.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.106:6812/33219 conn(0x7f82900308a0 legacy=0x7f8290032d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 >> v1:172.21.15.51:6790/0 conn(0x7f82b00629e0 legacy=0x7f82b01395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:03.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 shutdown_connections 2021-02-06T22:57:03.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 >> 172.21.15.51:0/1867742276 conn(0x7f82b0096860 msgr2=0x7f82b00989b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:03.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 shutdown_connections 2021-02-06T22:57:03.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 -- 172.21.15.51:0/1867742276 wait complete. 2021-02-06T22:57:03.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:03.271+0000 7f82b8341700 1 librados: shutdown 2021-02-06T22:57:03.282 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:06.283 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:06.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.418+0000 7f187b4be700 1 Processor -- start 2021-02-06T22:57:06.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f187b4be700 1 -- start start 2021-02-06T22:57:06.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f187b4be700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18740915d0 con 0x7f18740629e0 2021-02-06T22:57:06.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f187b4be700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1874091ac0 con 0x7f18740999a0 2021-02-06T22:57:06.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f187b4be700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1874091d60 con 0x7f18740928d0 2021-02-06T22:57:06.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f1878a59700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f18740629e0 0x7f1874090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60848/0 (socket says 172.21.15.51:60848) 2021-02-06T22:57:06.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f1878a59700 1 -- 172.21.15.51:0/2179832867 learned_addr learned my addr 172.21.15.51:0/2179832867 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:06.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.419+0000 7f1879a5b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f18740928d0 0x7f187412fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32960/0 (socket says 172.21.15.51:32960) 2021-02-06T22:57:06.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1879a5b700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.51:6790/0 conn(0x7f18740928d0 legacy=0x7f187412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1878a59700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.51:6789/0 conn(0x7f18740629e0 legacy=0x7f1874090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f187925a700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.106:6789/0 conn(0x7f18740999a0 legacy=0x7f18740907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889286336 0 0) 0x7f1874091d60 con 0x7f18740928d0 2021-02-06T22:57:06.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c003230 con 0x7f18740928d0 2021-02-06T22:57:06.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130108633 0 0) 0x7f18740915d0 con 0x7f18740629e0 2021-02-06T22:57:06.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1874091d60 con 0x7f18740629e0 2021-02-06T22:57:06.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552378374 0 0) 0x7f1874091ac0 con 0x7f18740999a0 2021-02-06T22:57:06.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18740915d0 con 0x7f18740999a0 2021-02-06T22:57:06.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 66752276 0 0) 0x7f185c003230 con 0x7f18740928d0 2021-02-06T22:57:06.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.106:6789/0 conn(0x7f18740999a0 legacy=0x7f18740907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.51:6789/0 conn(0x7f18740629e0 legacy=0x7f1874090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874092000 con 0x7f18740928d0 2021-02-06T22:57:06.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f186c001cb0 con 0x7f18740928d0 2021-02-06T22:57:06.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f186c001fc0 con 0x7f18740928d0 2021-02-06T22:57:06.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.422+0000 7f1863fff700 1 -- 172.21.15.51:0/2179832867 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f186c004a10 con 0x7f18740928d0 2021-02-06T22:57:06.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 -- 172.21.15.51:0/2179832867 >> v1:172.21.15.51:6790/0 conn(0x7f18740928d0 legacy=0x7f187412fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 -- 172.21.15.51:0/2179832867 shutdown_connections 2021-02-06T22:57:06.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 -- 172.21.15.51:0/2179832867 >> 172.21.15.51:0/2179832867 conn(0x7f1874096860 msgr2=0x7f1874099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:06.428 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 -- 172.21.15.51:0/2179832867 shutdown_connections 2021-02-06T22:57:06.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 -- 172.21.15.51:0/2179832867 wait complete. 2021-02-06T22:57:06.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 librados: starting msgr at 2021-02-06T22:57:06.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.423+0000 7f187b4be700 1 librados: starting objecter 2021-02-06T22:57:06.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 Processor -- start 2021-02-06T22:57:06.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 -- start start 2021-02-06T22:57:06.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 librados: setting wanted keys 2021-02-06T22:57:06.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 librados: calling monclient init 2021-02-06T22:57:06.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187413a650 con 0x7f18740928d0 2021-02-06T22:57:06.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187411af70 con 0x7f18740999a0 2021-02-06T22:57:06.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187b4be700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1874095160 con 0x7f18740629e0 2021-02-06T22:57:06.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187925a700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f18740629e0 0x7f1874139830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32962/0 (socket says 172.21.15.51:32962) 2021-02-06T22:57:06.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.424+0000 7f187925a700 1 -- 172.21.15.51:0/1098697224 learned_addr learned my addr 172.21.15.51:0/1098697224 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:06.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.426+0000 7f187925a700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.51:6790/0 conn(0x7f18740629e0 legacy=0x7f1874139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.434 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f1878a59700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.51:6789/0 conn(0x7f18740928d0 legacy=0x7f1874139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.426+0000 7f18617fa700 10 client.?.objecter ms_handle_connect 0x7f18740629e0 2021-02-06T22:57:06.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:06.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 10 client.?.objecter ms_handle_connect 0x7f18740928d0 2021-02-06T22:57:06.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:06.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576052515 0 0) 0x7f1874095160 con 0x7f18740629e0 2021-02-06T22:57:06.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854004bd0 con 0x7f18740629e0 2021-02-06T22:57:06.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3483965714 0 0) 0x7f187413a650 con 0x7f18740928d0 2021-02-06T22:57:06.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1874095160 con 0x7f18740928d0 2021-02-06T22:57:06.436 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f1879a5b700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.106:6789/0 conn(0x7f18740999a0 legacy=0x7f1874141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:06.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 10 client.?.objecter ms_handle_connect 0x7f18740999a0 2021-02-06T22:57:06.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:06.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388845332 0 0) 0x7f187411af70 con 0x7f18740999a0 2021-02-06T22:57:06.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187413a650 con 0x7f18740999a0 2021-02-06T22:57:06.437 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1127514194 0 0) 0x7f1854004bd0 con 0x7f18740629e0 2021-02-06T22:57:06.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f187411af70 con 0x7f18740629e0 2021-02-06T22:57:06.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1864001cf0 con 0x7f18740629e0 2021-02-06T22:57:06.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3423533595 0 0) 0x7f1874095160 con 0x7f18740928d0 2021-02-06T22:57:06.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1854004bd0 con 0x7f18740928d0 2021-02-06T22:57:06.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f1870001c60 con 0x7f18740928d0 2021-02-06T22:57:06.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3355346363 0 0) 0x7f187411af70 con 0x7f18740629e0 2021-02-06T22:57:06.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.106:6789/0 conn(0x7f18740999a0 legacy=0x7f1874141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.51:6789/0 conn(0x7f18740928d0 legacy=0x7f1874139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1874067460 con 0x7f18740629e0 2021-02-06T22:57:06.439 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187411a4c0 con 0x7f18740629e0 2021-02-06T22:57:06.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f187b4be700 10 client.4769.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:06.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f1874130830 con 0x7f18740629e0 2021-02-06T22:57:06.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f187b4be700 1 librados: init done 2021-02-06T22:57:06.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f18640023e0 con 0x7f18740629e0 2021-02-06T22:57:06.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.427+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f18640026f0 con 0x7f18740629e0 2021-02-06T22:57:06.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f18640028d0 con 0x7f18740629e0 2021-02-06T22:57:06.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f1864039590 con 0x7f18740629e0 2021-02-06T22:57:06.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 10 client.4769.objecter ms_dispatch 0x7f1874001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:06.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 3 client.4769.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:06.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 3 client.4769.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:06.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f18617fa700 20 client.4769.objecter dump_active .. 0 homeless 2021-02-06T22:57:06.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.428+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c004d60 con 0x7f18740629e0 2021-02-06T22:57:06.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.431+0000 7f18617fa700 10 client.4769.objecter ms_handle_connect 0x7f1854030740 2021-02-06T22:57:06.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.433+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f1864012480 con 0x7f18740629e0 2021-02-06T22:57:06.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.686+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f184c0059b0 con 0x7f18740629e0 2021-02-06T22:57:06.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.687+0000 7f18617fa700 1 -- 172.21.15.51:0/1098697224 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f1864012070 con 0x7f18740629e0 2021-02-06T22:57:06.687 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:06.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 10 librados: watch_flush enter 2021-02-06T22:57:06.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 10 librados: watch_flush exit 2021-02-06T22:57:06.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 20 client.4769.objecter shutdown clearing up homeless session... 2021-02-06T22:57:06.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 10 client.4769.objecter successfully canceled tick 2021-02-06T22:57:06.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.106:6812/33219 conn(0x7f1854030740 legacy=0x7f1854032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 >> v1:172.21.15.51:6790/0 conn(0x7f18740629e0 legacy=0x7f1874139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:06.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 shutdown_connections 2021-02-06T22:57:06.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 >> 172.21.15.51:0/1098697224 conn(0x7f1874096860 msgr2=0x7f1874066900 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:06.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 shutdown_connections 2021-02-06T22:57:06.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 -- 172.21.15.51:0/1098697224 wait complete. 2021-02-06T22:57:06.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:06.688+0000 7f187b4be700 1 librados: shutdown 2021-02-06T22:57:06.700 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:09.701 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:09.835 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.835+0000 7f0ad3692700 1 Processor -- start 2021-02-06T22:57:09.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.835+0000 7f0ad3692700 1 -- start start 2021-02-06T22:57:09.836 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad3692700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc0915d0 con 0x7f0acc0999a0 2021-02-06T22:57:09.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad3692700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc091ac0 con 0x7f0acc0928d0 2021-02-06T22:57:09.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad3692700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc091d60 con 0x7f0acc0629e0 2021-02-06T22:57:09.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad0c2d700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0acc0629e0 0x7f0acc090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32972/0 (socket says 172.21.15.51:32972) 2021-02-06T22:57:09.837 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad142e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0acc0999a0 0x7f0acc0907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60860/0 (socket says 172.21.15.51:60860) 2021-02-06T22:57:09.838 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.836+0000 7f0ad0c2d700 1 -- 172.21.15.51:0/789672448 learned_addr learned my addr 172.21.15.51:0/789672448 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:09.839 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0ad0c2d700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.51:6790/0 conn(0x7f0acc0629e0 legacy=0x7f0acc090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0ad142e700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.51:6789/0 conn(0x7f0acc0999a0 legacy=0x7f0acc0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393313251 0 0) 0x7f0acc091d60 con 0x7f0acc0629e0 2021-02-06T22:57:09.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab4003230 con 0x7f0acc0629e0 2021-02-06T22:57:09.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758014053 0 0) 0x7f0acc0915d0 con 0x7f0acc0999a0 2021-02-06T22:57:09.840 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc091d60 con 0x7f0acc0999a0 2021-02-06T22:57:09.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0ad1c2f700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.106:6789/0 conn(0x7f0acc0928d0 legacy=0x7f0acc12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 384846354 0 0) 0x7f0acc091d60 con 0x7f0acc0999a0 2021-02-06T22:57:09.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.51:6790/0 conn(0x7f0acc0629e0 legacy=0x7f0acc090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:09.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.838+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.106:6789/0 conn(0x7f0acc0928d0 legacy=0x7f0acc12fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:09.841 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc092000 con 0x7f0acc0999a0 2021-02-06T22:57:09.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ac8001930 con 0x7f0acc0999a0 2021-02-06T22:57:09.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ac8001c40 con 0x7f0acc0999a0 2021-02-06T22:57:09.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0abffff700 1 -- 172.21.15.51:0/789672448 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ac8004690 con 0x7f0acc0999a0 2021-02-06T22:57:09.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0ad3692700 1 -- 172.21.15.51:0/789672448 >> v1:172.21.15.51:6789/0 conn(0x7f0acc0999a0 legacy=0x7f0acc0907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:09.842 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0ad3692700 1 -- 172.21.15.51:0/789672448 shutdown_connections 2021-02-06T22:57:09.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0ad3692700 1 -- 172.21.15.51:0/789672448 >> 172.21.15.51:0/789672448 conn(0x7f0acc096860 msgr2=0x7f0acc099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:09.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0ad3692700 1 -- 172.21.15.51:0/789672448 shutdown_connections 2021-02-06T22:57:09.843 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.839+0000 7f0ad3692700 1 -- 172.21.15.51:0/789672448 wait complete. 2021-02-06T22:57:09.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 librados: starting msgr at 2021-02-06T22:57:09.846 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 librados: starting objecter 2021-02-06T22:57:09.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 Processor -- start 2021-02-06T22:57:09.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 -- start start 2021-02-06T22:57:09.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 librados: setting wanted keys 2021-02-06T22:57:09.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.840+0000 7f0ad3692700 1 librados: calling monclient init 2021-02-06T22:57:09.847 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.841+0000 7f0ad3692700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc130a60 con 0x7f0acc0629e0 2021-02-06T22:57:09.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.841+0000 7f0ad3692700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc118aa0 con 0x7f0acc0928d0 2021-02-06T22:57:09.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.841+0000 7f0ad3692700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc118d40 con 0x7f0acc0999a0 2021-02-06T22:57:09.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.841+0000 7f0ad142e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0acc0629e0 0x7f0acc130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60866/0 (socket says 172.21.15.51:60866) 2021-02-06T22:57:09.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.841+0000 7f0ad142e700 1 -- 172.21.15.51:0/2026209668 learned_addr learned my addr 172.21.15.51:0/2026209668 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:09.848 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0ad142e700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.51:6789/0 conn(0x7f0acc0629e0 legacy=0x7f0acc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0ad1c2f700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.51:6790/0 conn(0x7f0acc0999a0 legacy=0x7f0acc1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter ms_handle_connect 0x7f0acc0629e0 2021-02-06T22:57:09.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:09.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter ms_handle_connect 0x7f0acc0999a0 2021-02-06T22:57:09.849 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:09.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477166168 0 0) 0x7f0acc118d40 con 0x7f0acc0999a0 2021-02-06T22:57:09.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aac004bd0 con 0x7f0acc0999a0 2021-02-06T22:57:09.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127909667 0 0) 0x7f0acc130a60 con 0x7f0acc0629e0 2021-02-06T22:57:09.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc118d40 con 0x7f0acc0629e0 2021-02-06T22:57:09.850 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter ms_handle_connect 0x7f0acc0928d0 2021-02-06T22:57:09.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:09.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0ad0c2d700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.106:6789/0 conn(0x7f0acc0928d0 legacy=0x7f0acc13c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:09.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 543378517 0 0) 0x7f0aac004bd0 con 0x7f0acc0999a0 2021-02-06T22:57:09.851 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0acc130a60 con 0x7f0acc0999a0 2021-02-06T22:57:09.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ac4001f60 con 0x7f0acc0999a0 2021-02-06T22:57:09.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2613244660 0 0) 0x7f0acc118d40 con 0x7f0acc0629e0 2021-02-06T22:57:09.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0aac004bd0 con 0x7f0acc0629e0 2021-02-06T22:57:09.852 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.843+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ac8004690 con 0x7f0acc0629e0 2021-02-06T22:57:09.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002183695 0 0) 0x7f0acc118aa0 con 0x7f0acc0928d0 2021-02-06T22:57:09.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0acc118d40 con 0x7f0acc0928d0 2021-02-06T22:57:09.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1531552391 0 0) 0x7f0acc130a60 con 0x7f0acc0999a0 2021-02-06T22:57:09.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.106:6789/0 conn(0x7f0acc0928d0 legacy=0x7f0acc13c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:09.853 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.51:6789/0 conn(0x7f0acc0629e0 legacy=0x7f0acc130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:09.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc094850 con 0x7f0acc0999a0 2021-02-06T22:57:09.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc117060 con 0x7f0acc0999a0 2021-02-06T22:57:09.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0ad3692700 10 client.4775.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:09.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc093f40 con 0x7f0acc0999a0 2021-02-06T22:57:09.854 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0ad3692700 1 librados: init done 2021-02-06T22:57:09.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0ac40025f0 con 0x7f0acc0999a0 2021-02-06T22:57:09.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0ac4002900 con 0x7f0acc0999a0 2021-02-06T22:57:09.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.844+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0ac4002ae0 con 0x7f0acc0999a0 2021-02-06T22:57:09.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0ac4039750 con 0x7f0acc0999a0 2021-02-06T22:57:09.855 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0abd7fa700 10 client.4775.objecter ms_dispatch 0x7f0acc001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:09.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0abd7fa700 3 client.4775.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:09.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0abd7fa700 3 client.4775.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:09.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0abd7fa700 20 client.4775.objecter dump_active .. 0 homeless 2021-02-06T22:57:09.856 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.845+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa4004d60 con 0x7f0acc0999a0 2021-02-06T22:57:09.857 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.847+0000 7f0abd7fa700 10 client.4775.objecter ms_handle_connect 0x7f0aac030780 2021-02-06T22:57:09.857 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:09.849+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0ac4003050 con 0x7f0acc0999a0 2021-02-06T22:57:10.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.104+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0aa40059b0 con 0x7f0acc0999a0 2021-02-06T22:57:10.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.104+0000 7f0abd7fa700 1 -- 172.21.15.51:0/2026209668 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f0ac4012640 con 0x7f0acc0999a0 2021-02-06T22:57:10.105 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:10.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 10 librados: watch_flush enter 2021-02-06T22:57:10.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 10 librados: watch_flush exit 2021-02-06T22:57:10.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 20 client.4775.objecter shutdown clearing up homeless session... 2021-02-06T22:57:10.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 10 client.4775.objecter successfully canceled tick 2021-02-06T22:57:10.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.106:6812/33219 conn(0x7f0aac030780 legacy=0x7f0aac032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:10.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 >> v1:172.21.15.51:6790/0 conn(0x7f0acc0999a0 legacy=0x7f0acc1400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:10.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 shutdown_connections 2021-02-06T22:57:10.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 >> 172.21.15.51:0/2026209668 conn(0x7f0acc096860 msgr2=0x7f0acc0666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:10.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 shutdown_connections 2021-02-06T22:57:10.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 -- 172.21.15.51:0/2026209668 wait complete. 2021-02-06T22:57:10.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:10.106+0000 7f0ad3692700 1 librados: shutdown 2021-02-06T22:57:10.118 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:10.422 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.421+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.422 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.421+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,logm=76} crc {auth=2532997670,config=3140514009,health=3706708781,logm=3411830422}) 2021-02-06T22:57:10.423 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.421+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=10,config=2,health=12,logm=76} crc {auth=160075616,config=3140514009,health=3706708781,logm=1390254682}) 2021-02-06T22:57:10.423 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.421+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.423 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.421+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=10,config=2,health=12,logm=76} crc {auth=2532997670,config=3140514009,health=3706708781,logm=3411830422}) 2021-02-06T22:57:10.423 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.422+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=9,config=2,health=10,logm=79} crc {auth=411490707,config=3140514009,health=3892761734,logm=3413123312}) 2021-02-06T22:57:10.452 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.452 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2784091089}) 2021-02-06T22:57:10.452 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2245968046}) 2021-02-06T22:57:10.453 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.453 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2784091089}) 2021-02-06T22:57:10.453 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.452+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3145673150}) 2021-02-06T22:57:10.694 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.695 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91106571}) 2021-02-06T22:57:10.695 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2989062009}) 2021-02-06T22:57:10.695 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.695 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91106571}) 2021-02-06T22:57:10.695 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.694+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3146531838}) 2021-02-06T22:57:10.700 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.701 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2622547415}) 2021-02-06T22:57:10.701 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=98,mdsmap=2} crc {logm=1045666498,mdsmap=3585761405}) 2021-02-06T22:57:10.701 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.701 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2622547415}) 2021-02-06T22:57:10.702 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.701+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316841266}) 2021-02-06T22:57:10.710 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.711 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=2,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=3,monmap=2,osd_metadata=5,osd_pg_creating=1,osdmap=28} crc {logm=436305584,mdsmap=1531151339,mgr=1433884904,mgr_command_descs=203983355,mgr_metadata=1153297813,mgrstat=529588322,mon_config_key=234355882,monmap=3140514009,osd_metadata=1423577141,osd_pg_creating=1590583613,osdmap=3073833331}) 2021-02-06T22:57:10.711 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=2,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=2,monmap=3,osd_metadata=4,osd_pg_creating=1,osdmap=31} crc {logm=436305584,mdsmap=1531151339,mgr=1781400551,mgr_command_descs=203983355,mgr_metadata=1153297813,mgrstat=3216496466,mon_config_key=196644270,monmap=2177283469,osd_metadata=2463198358,osd_pg_creating=1590583613,osdmap=255752355}) 2021-02-06T22:57:10.711 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : scrub mismatch 2021-02-06T22:57:10.711 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=2,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=3,monmap=2,osd_metadata=5,osd_pg_creating=1,osdmap=28} crc {logm=436305584,mdsmap=1531151339,mgr=1433884904,mgr_command_descs=203983355,mgr_metadata=1153297813,mgrstat=529588322,mon_config_key=234355882,monmap=3140514009,osd_metadata=1423577141,osd_pg_creating=1590583613,osdmap=3073833331}) 2021-02-06T22:57:10.712 INFO:tasks.ceph.mon.a.smithi051.stderr:2021-02-06T22:57:10.710+0000 7f3090c4c700 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=2,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=3,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=32} crc {logm=436305584,mdsmap=1531151339,mgr=1433884904,mgr_command_descs=203983355,mgr_metadata=1153297813,mgrstat=2248192022,mon_config_key=234355882,monmap=2177283469,osd_metadata=1423577141,osd_pg_creating=1590583613,osdmap=457290440}) 2021-02-06T22:57:13.119 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:13.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.254+0000 7f4694207700 1 Processor -- start 2021-02-06T22:57:13.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.254+0000 7f4694207700 1 -- start start 2021-02-06T22:57:13.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f4694207700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c095440 con 0x7f468c08fa70 2021-02-06T22:57:13.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f4694207700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0907b0 con 0x7f468c12ce00 2021-02-06T22:57:13.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f4694207700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c091010 con 0x7f468c092bf0 2021-02-06T22:57:13.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f4691fa3700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f468c08fa70 0x7f468c0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60874/0 (socket says 172.21.15.51:60874) 2021-02-06T22:57:13.256 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f46917a2700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f468c092bf0 0x7f468c0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32984/0 (socket says 172.21.15.51:32984) 2021-02-06T22:57:13.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.255+0000 7f4691fa3700 1 -- 172.21.15.51:0/3070893764 learned_addr learned my addr 172.21.15.51:0/3070893764 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:13.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f46917a2700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.51:6790/0 conn(0x7f468c092bf0 legacy=0x7f468c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4691fa3700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.51:6789/0 conn(0x7f468c08fa70 legacy=0x7f468c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f46927a4700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.106:6789/0 conn(0x7f468c12ce00 legacy=0x7f468c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606191464 0 0) 0x7f468c095440 con 0x7f468c08fa70 2021-02-06T22:57:13.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4674003230 con 0x7f468c08fa70 2021-02-06T22:57:13.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069178738 0 0) 0x7f468c091010 con 0x7f468c092bf0 2021-02-06T22:57:13.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c095440 con 0x7f468c092bf0 2021-02-06T22:57:13.260 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319970851 0 0) 0x7f468c0907b0 con 0x7f468c12ce00 2021-02-06T22:57:13.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c091010 con 0x7f468c12ce00 2021-02-06T22:57:13.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3030195340 0 0) 0x7f468c095440 con 0x7f468c092bf0 2021-02-06T22:57:13.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.106:6789/0 conn(0x7f468c12ce00 legacy=0x7f468c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.257+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.51:6789/0 conn(0x7f468c08fa70 legacy=0x7f468c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0912b0 con 0x7f468c092bf0 2021-02-06T22:57:13.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4688001930 con 0x7f468c092bf0 2021-02-06T22:57:13.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4688001c40 con 0x7f468c092bf0 2021-02-06T22:57:13.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4690fa1700 1 -- 172.21.15.51:0/3070893764 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4688004690 con 0x7f468c092bf0 2021-02-06T22:57:13.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4694207700 1 -- 172.21.15.51:0/3070893764 >> v1:172.21.15.51:6790/0 conn(0x7f468c092bf0 legacy=0x7f468c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4694207700 1 -- 172.21.15.51:0/3070893764 shutdown_connections 2021-02-06T22:57:13.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4694207700 1 -- 172.21.15.51:0/3070893764 >> 172.21.15.51:0/3070893764 conn(0x7f468c096860 msgr2=0x7f468c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:13.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4694207700 1 -- 172.21.15.51:0/3070893764 shutdown_connections 2021-02-06T22:57:13.263 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.258+0000 7f4694207700 1 -- 172.21.15.51:0/3070893764 wait complete. 2021-02-06T22:57:13.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 librados: starting msgr at 2021-02-06T22:57:13.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 librados: starting objecter 2021-02-06T22:57:13.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 Processor -- start 2021-02-06T22:57:13.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 -- start start 2021-02-06T22:57:13.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 librados: setting wanted keys 2021-02-06T22:57:13.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.259+0000 7f4694207700 1 librados: calling monclient init 2021-02-06T22:57:13.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.260+0000 7f4694207700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c10fe90 con 0x7f468c092bf0 2021-02-06T22:57:13.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.260+0000 7f4694207700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c12c320 con 0x7f468c12ce00 2021-02-06T22:57:13.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.260+0000 7f4694207700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c1100c0 con 0x7f468c08fa70 2021-02-06T22:57:13.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.260+0000 7f4691fa3700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f468c08fa70 0x7f468c12b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:32990/0 (socket says 172.21.15.51:32990) 2021-02-06T22:57:13.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.260+0000 7f4691fa3700 1 -- 172.21.15.51:0/3044885093 learned_addr learned my addr 172.21.15.51:0/3044885093 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:13.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f46917a2700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.51:6789/0 conn(0x7f468c092bf0 legacy=0x7f468c12bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4691fa3700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.51:6790/0 conn(0x7f468c08fa70 legacy=0x7f468c12b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter ms_handle_connect 0x7f468c092bf0 2021-02-06T22:57:13.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:13.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter ms_handle_connect 0x7f468c08fa70 2021-02-06T22:57:13.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:13.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter ms_handle_connect 0x7f468c12ce00 2021-02-06T22:57:13.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:13.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f46927a4700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.106:6789/0 conn(0x7f468c12ce00 legacy=0x7f468c13ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:13.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035973788 0 0) 0x7f468c10fe90 con 0x7f468c092bf0 2021-02-06T22:57:13.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f466c004bd0 con 0x7f468c092bf0 2021-02-06T22:57:13.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304378242 0 0) 0x7f468c1100c0 con 0x7f468c08fa70 2021-02-06T22:57:13.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c10fe90 con 0x7f468c08fa70 2021-02-06T22:57:13.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529701455 0 0) 0x7f468c12c320 con 0x7f468c12ce00 2021-02-06T22:57:13.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f468c1100c0 con 0x7f468c12ce00 2021-02-06T22:57:13.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1520096449 0 0) 0x7f468c10fe90 con 0x7f468c08fa70 2021-02-06T22:57:13.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f468c12c320 con 0x7f468c08fa70 2021-02-06T22:57:13.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f467c001c10 con 0x7f468c08fa70 2021-02-06T22:57:13.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 652802365 0 0) 0x7f466c004bd0 con 0x7f468c092bf0 2021-02-06T22:57:13.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f468c10fe90 con 0x7f468c092bf0 2021-02-06T22:57:13.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f46880018f0 con 0x7f468c092bf0 2021-02-06T22:57:13.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3053173900 0 0) 0x7f468c1100c0 con 0x7f468c12ce00 2021-02-06T22:57:13.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f466c004bd0 con 0x7f468c12ce00 2021-02-06T22:57:13.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1914826361 0 0) 0x7f468c12c320 con 0x7f468c08fa70 2021-02-06T22:57:13.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.106:6789/0 conn(0x7f468c12ce00 legacy=0x7f468c13ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.51:6789/0 conn(0x7f468c092bf0 legacy=0x7f468c12bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.262+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c110360 con 0x7f468c08fa70 2021-02-06T22:57:13.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c090c50 con 0x7f468c08fa70 2021-02-06T22:57:13.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f467c0047a0 con 0x7f468c08fa70 2021-02-06T22:57:13.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f467c004ab0 con 0x7f468c08fa70 2021-02-06T22:57:13.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4694207700 10 client.4781.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:13.278 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c128c50 con 0x7f468c08fa70 2021-02-06T22:57:13.278 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4694207700 1 librados: init done 2021-02-06T22:57:13.278 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f467c00d2f0 con 0x7f468c08fa70 2021-02-06T22:57:13.278 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f467c039360 con 0x7f468c08fa70 2021-02-06T22:57:13.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 10 client.4781.objecter ms_dispatch 0x7f468c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:13.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 3 client.4781.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:13.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 3 client.4781.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:13.279 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.263+0000 7f4679ffb700 20 client.4781.objecter dump_active .. 0 homeless 2021-02-06T22:57:13.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.264+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c0581b0 con 0x7f468c08fa70 2021-02-06T22:57:13.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.266+0000 7f4679ffb700 10 client.4781.objecter ms_handle_connect 0x7f466c0307e0 2021-02-06T22:57:13.280 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.268+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f467c0121f0 con 0x7f468c08fa70 2021-02-06T22:57:13.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.519+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f468c131bb0 con 0x7f468c08fa70 2021-02-06T22:57:13.519 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.519+0000 7f4679ffb700 1 -- 172.21.15.51:0/3044885093 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f467c011de0 con 0x7f468c08fa70 2021-02-06T22:57:13.520 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:13.521 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.520+0000 7f4694207700 10 librados: watch_flush enter 2021-02-06T22:57:13.521 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.520+0000 7f4694207700 10 librados: watch_flush exit 2021-02-06T22:57:13.522 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.520+0000 7f4694207700 20 client.4781.objecter shutdown clearing up homeless session... 2021-02-06T22:57:13.522 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.520+0000 7f4694207700 10 client.4781.objecter successfully canceled tick 2021-02-06T22:57:13.522 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.106:6812/33219 conn(0x7f466c0307e0 legacy=0x7f466c032ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.522 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 >> v1:172.21.15.51:6790/0 conn(0x7f468c08fa70 legacy=0x7f468c12b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:13.523 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 shutdown_connections 2021-02-06T22:57:13.523 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 >> 172.21.15.51:0/3044885093 conn(0x7f468c096860 msgr2=0x7f468c093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:13.523 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 shutdown_connections 2021-02-06T22:57:13.523 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 -- 172.21.15.51:0/3044885093 wait complete. 2021-02-06T22:57:13.523 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:13.521+0000 7f4694207700 1 librados: shutdown 2021-02-06T22:57:13.532 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:16.534 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:16.669 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.669+0000 7ff2164ba700 1 Processor -- start 2021-02-06T22:57:16.670 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.669+0000 7ff2164ba700 1 -- start start 2021-02-06T22:57:16.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff2164ba700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210095440 con 0x7ff21008fa70 2021-02-06T22:57:16.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff2164ba700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100907b0 con 0x7ff21012ce00 2021-02-06T22:57:16.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff2164ba700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210091010 con 0x7ff210092bf0 2021-02-06T22:57:16.671 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff20f7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff210092bf0 0x7ff2100930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33002/0 (socket says 172.21.15.51:33002) 2021-02-06T22:57:16.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff20ffff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff21008fa70 0x7ff2100921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60892/0 (socket says 172.21.15.51:60892) 2021-02-06T22:57:16.672 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.670+0000 7ff20f7fe700 1 -- 172.21.15.51:0/2569224857 learned_addr learned my addr 172.21.15.51:0/2569224857 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:16.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20f7fe700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.51:6790/0 conn(0x7ff210092bf0 legacy=0x7ff2100930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20ffff700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.51:6789/0 conn(0x7ff21008fa70 legacy=0x7ff2100921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996881754 0 0) 0x7ff210095440 con 0x7ff21008fa70 2021-02-06T22:57:16.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1fc003230 con 0x7ff21008fa70 2021-02-06T22:57:16.674 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170588316 0 0) 0x7ff210091010 con 0x7ff210092bf0 2021-02-06T22:57:16.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff210095440 con 0x7ff210092bf0 2021-02-06T22:57:16.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff214a57700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.106:6789/0 conn(0x7ff21012ce00 legacy=0x7ff21012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.672+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3067984132 0 0) 0x7ff1fc003230 con 0x7ff21008fa70 2021-02-06T22:57:16.675 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.51:6790/0 conn(0x7ff210092bf0 legacy=0x7ff2100930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.106:6789/0 conn(0x7ff21012ce00 legacy=0x7ff21012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100912b0 con 0x7ff21008fa70 2021-02-06T22:57:16.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff200001930 con 0x7ff21008fa70 2021-02-06T22:57:16.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff200001c40 con 0x7ff21008fa70 2021-02-06T22:57:16.676 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff20effd700 1 -- 172.21.15.51:0/2569224857 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff200004690 con 0x7ff21008fa70 2021-02-06T22:57:16.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff2164ba700 1 -- 172.21.15.51:0/2569224857 >> v1:172.21.15.51:6789/0 conn(0x7ff21008fa70 legacy=0x7ff2100921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff2164ba700 1 -- 172.21.15.51:0/2569224857 shutdown_connections 2021-02-06T22:57:16.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff2164ba700 1 -- 172.21.15.51:0/2569224857 >> 172.21.15.51:0/2569224857 conn(0x7ff210096860 msgr2=0x7ff210099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:16.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff2164ba700 1 -- 172.21.15.51:0/2569224857 shutdown_connections 2021-02-06T22:57:16.677 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.673+0000 7ff2164ba700 1 -- 172.21.15.51:0/2569224857 wait complete. 2021-02-06T22:57:16.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 librados: starting msgr at 2021-02-06T22:57:16.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 librados: starting objecter 2021-02-06T22:57:16.681 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 Processor -- start 2021-02-06T22:57:16.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 -- start start 2021-02-06T22:57:16.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 librados: setting wanted keys 2021-02-06T22:57:16.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.674+0000 7ff2164ba700 1 librados: calling monclient init 2021-02-06T22:57:16.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.675+0000 7ff2164ba700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210110750 con 0x7ff21012ce00 2021-02-06T22:57:16.682 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.675+0000 7ff2164ba700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2101109f0 con 0x7ff210092bf0 2021-02-06T22:57:16.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.675+0000 7ff2164ba700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff210110c90 con 0x7ff21008fa70 2021-02-06T22:57:16.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.675+0000 7ff20ffff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff21008fa70 0x7ff2101294b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33008/0 (socket says 172.21.15.51:33008) 2021-02-06T22:57:16.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.675+0000 7ff20ffff700 1 -- 172.21.15.51:0/2810884186 learned_addr learned my addr 172.21.15.51:0/2810884186 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:16.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff214a57700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.51:6789/0 conn(0x7ff21012ce00 legacy=0x7ff210142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.683 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff20ffff700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.51:6790/0 conn(0x7ff21008fa70 legacy=0x7ff2101294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter ms_handle_connect 0x7ff21012ce00 2021-02-06T22:57:16.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:16.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter ms_handle_connect 0x7ff21008fa70 2021-02-06T22:57:16.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:16.684 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368860211 0 0) 0x7ff210110750 con 0x7ff21012ce00 2021-02-06T22:57:16.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f0004bd0 con 0x7ff21012ce00 2021-02-06T22:57:16.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134291982 0 0) 0x7ff210110c90 con 0x7ff21008fa70 2021-02-06T22:57:16.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff210110750 con 0x7ff21008fa70 2021-02-06T22:57:16.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter ms_handle_connect 0x7ff210092bf0 2021-02-06T22:57:16.685 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:16.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff20f7fe700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.106:6789/0 conn(0x7ff210092bf0 legacy=0x7ff210129bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:16.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 222843101 0 0) 0x7ff1f0004bd0 con 0x7ff21012ce00 2021-02-06T22:57:16.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff210110c90 con 0x7ff21012ce00 2021-02-06T22:57:16.686 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff208001e20 con 0x7ff21012ce00 2021-02-06T22:57:16.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.677+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 626783933 0 0) 0x7ff210110750 con 0x7ff21008fa70 2021-02-06T22:57:16.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1f0004bd0 con 0x7ff21008fa70 2021-02-06T22:57:16.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff2000018f0 con 0x7ff21008fa70 2021-02-06T22:57:16.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935366134 0 0) 0x7ff2101109f0 con 0x7ff210092bf0 2021-02-06T22:57:16.687 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff210110750 con 0x7ff210092bf0 2021-02-06T22:57:16.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3749205302 0 0) 0x7ff210110c90 con 0x7ff21012ce00 2021-02-06T22:57:16.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.51:6790/0 conn(0x7ff21008fa70 legacy=0x7ff2101294b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.106:6789/0 conn(0x7ff210092bf0 legacy=0x7ff210129bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21012a2d0 con 0x7ff21012ce00 2021-02-06T22:57:16.688 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21012b080 con 0x7ff21012ce00 2021-02-06T22:57:16.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff2164ba700 10 client.4815.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:16.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff210111050 con 0x7ff21012ce00 2021-02-06T22:57:16.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff2164ba700 1 librados: init done 2021-02-06T22:57:16.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff2080025f0 con 0x7ff21012ce00 2021-02-06T22:57:16.689 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff208002900 con 0x7ff21012ce00 2021-02-06T22:57:16.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.678+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ff208002ae0 con 0x7ff21012ce00 2021-02-06T22:57:16.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e8004d60 con 0x7ff21012ce00 2021-02-06T22:57:16.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ff208039690 con 0x7ff21012ce00 2021-02-06T22:57:16.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff1f7fff700 10 client.4815.objecter ms_dispatch 0x7ff210001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:16.690 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff1f7fff700 3 client.4815.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:16.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff1f7fff700 3 client.4815.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:16.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.679+0000 7ff1f7fff700 20 client.4815.objecter dump_active .. 0 homeless 2021-02-06T22:57:16.691 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.681+0000 7ff1f7fff700 10 client.4815.objecter ms_handle_connect 0x7ff1f00307f0 2021-02-06T22:57:16.692 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.683+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7ff208012310 con 0x7ff21012ce00 2021-02-06T22:57:16.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.934+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff1e80059b0 con 0x7ff21012ce00 2021-02-06T22:57:16.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.934+0000 7ff1f7fff700 1 -- 172.21.15.51:0/2810884186 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7ff208012130 con 0x7ff21012ce00 2021-02-06T22:57:16.935 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:16.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 10 librados: watch_flush enter 2021-02-06T22:57:16.936 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 10 librados: watch_flush exit 2021-02-06T22:57:16.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 20 client.4815.objecter shutdown clearing up homeless session... 2021-02-06T22:57:16.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 10 client.4815.objecter successfully canceled tick 2021-02-06T22:57:16.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.106:6812/33219 conn(0x7ff1f00307f0 legacy=0x7ff1f0032cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.937 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 >> v1:172.21.15.51:6789/0 conn(0x7ff21012ce00 legacy=0x7ff210142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:16.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 shutdown_connections 2021-02-06T22:57:16.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 >> 172.21.15.51:0/2810884186 conn(0x7ff210096860 msgr2=0x7ff210122ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:16.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 shutdown_connections 2021-02-06T22:57:16.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 -- 172.21.15.51:0/2810884186 wait complete. 2021-02-06T22:57:16.938 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:16.936+0000 7ff2164ba700 1 librados: shutdown 2021-02-06T22:57:16.947 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:19.948 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:20.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff594966700 1 Processor -- start 2021-02-06T22:57:20.082 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff594966700 1 -- start start 2021-02-06T22:57:20.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff594966700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900953e0 con 0x7ff59012cd50 2021-02-06T22:57:20.083 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff594966700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff590094900 con 0x7ff59008f510 2021-02-06T22:57:20.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff594966700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff590090dd0 con 0x7ff590091f60 2021-02-06T22:57:20.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.082+0000 7ff58e59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff590091f60 0x7ff5900941f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33016/0 (socket says 172.21.15.51:33016) 2021-02-06T22:57:20.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.083+0000 7ff58f59e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff59012cd50 0x7ff59012f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60910/0 (socket says 172.21.15.51:60910) 2021-02-06T22:57:20.084 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.083+0000 7ff58e59c700 1 -- 172.21.15.51:0/2241799606 learned_addr learned my addr 172.21.15.51:0/2241799606 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:20.086 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58e59c700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.51:6790/0 conn(0x7ff590091f60 legacy=0x7ff5900941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58f59e700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.51:6789/0 conn(0x7ff59012cd50 legacy=0x7ff59012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58ed9d700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.106:6789/0 conn(0x7ff59008f510 legacy=0x7ff590093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261219839 0 0) 0x7ff590090dd0 con 0x7ff590091f60 2021-02-06T22:57:20.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff570003230 con 0x7ff590091f60 2021-02-06T22:57:20.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820909518 0 0) 0x7ff5900953e0 con 0x7ff59012cd50 2021-02-06T22:57:20.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590090dd0 con 0x7ff59012cd50 2021-02-06T22:57:20.088 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593013417 0 0) 0x7ff590094900 con 0x7ff59008f510 2021-02-06T22:57:20.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5900953e0 con 0x7ff59008f510 2021-02-06T22:57:20.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2541010092 0 0) 0x7ff570003230 con 0x7ff590091f60 2021-02-06T22:57:20.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.106:6789/0 conn(0x7ff59008f510 legacy=0x7ff590093ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.51:6789/0 conn(0x7ff59012cd50 legacy=0x7ff59012f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590091070 con 0x7ff590091f60 2021-02-06T22:57:20.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff580001930 con 0x7ff590091f60 2021-02-06T22:57:20.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff580001c40 con 0x7ff590091f60 2021-02-06T22:57:20.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.085+0000 7ff58dd9b700 1 -- 172.21.15.51:0/2241799606 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff580004750 con 0x7ff590091f60 2021-02-06T22:57:20.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.086+0000 7ff594966700 1 -- 172.21.15.51:0/2241799606 >> v1:172.21.15.51:6790/0 conn(0x7ff590091f60 legacy=0x7ff5900941f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.086+0000 7ff594966700 1 -- 172.21.15.51:0/2241799606 shutdown_connections 2021-02-06T22:57:20.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.086+0000 7ff594966700 1 -- 172.21.15.51:0/2241799606 >> 172.21.15.51:0/2241799606 conn(0x7ff590095be0 msgr2=0x7ff590095ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:20.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.086+0000 7ff594966700 1 -- 172.21.15.51:0/2241799606 shutdown_connections 2021-02-06T22:57:20.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.086+0000 7ff594966700 1 -- 172.21.15.51:0/2241799606 wait complete. 2021-02-06T22:57:20.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 librados: starting msgr at 2021-02-06T22:57:20.095 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 librados: starting objecter 2021-02-06T22:57:20.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 Processor -- start 2021-02-06T22:57:20.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 -- start start 2021-02-06T22:57:20.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 librados: setting wanted keys 2021-02-06T22:57:20.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.087+0000 7ff594966700 1 librados: calling monclient init 2021-02-06T22:57:20.096 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff594966700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff590090830 con 0x7ff590091f60 2021-02-06T22:57:20.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff594966700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff590067120 con 0x7ff59008f510 2021-02-06T22:57:20.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff594966700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900673c0 con 0x7ff59012cd50 2021-02-06T22:57:20.097 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff58f59e700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7ff59012cd50 0x7ff59013dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33026/0 (socket says 172.21.15.51:33026) 2021-02-06T22:57:20.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff58f59e700 1 -- 172.21.15.51:0/1554146789 learned_addr learned my addr 172.21.15.51:0/1554146789 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:20.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.088+0000 7ff58e59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7ff590091f60 0x7ff59013a470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60914/0 (socket says 172.21.15.51:60914) 2021-02-06T22:57:20.098 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff58e59c700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.51:6789/0 conn(0x7ff590091f60 legacy=0x7ff59013a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff58f59e700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.51:6790/0 conn(0x7ff59012cd50 legacy=0x7ff59013dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter ms_handle_connect 0x7ff590091f60 2021-02-06T22:57:20.099 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:20.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter ms_handle_connect 0x7ff59012cd50 2021-02-06T22:57:20.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:20.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450435982 0 0) 0x7ff5900673c0 con 0x7ff59012cd50 2021-02-06T22:57:20.100 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff58ed9d700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.106:6789/0 conn(0x7ff59008f510 legacy=0x7ff5901356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:20.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff574004bd0 con 0x7ff59012cd50 2021-02-06T22:57:20.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter ms_handle_connect 0x7ff59008f510 2021-02-06T22:57:20.101 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:20.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679683308 0 0) 0x7ff590090830 con 0x7ff590091f60 2021-02-06T22:57:20.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5900673c0 con 0x7ff590091f60 2021-02-06T22:57:20.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577059582 0 0) 0x7ff590067120 con 0x7ff59008f510 2021-02-06T22:57:20.102 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff590090830 con 0x7ff59008f510 2021-02-06T22:57:20.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1901828529 0 0) 0x7ff574004bd0 con 0x7ff59012cd50 2021-02-06T22:57:20.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff590067120 con 0x7ff59012cd50 2021-02-06T22:57:20.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff588004870 con 0x7ff59012cd50 2021-02-06T22:57:20.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1725145153 0 0) 0x7ff5900673c0 con 0x7ff590091f60 2021-02-06T22:57:20.103 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff574004bd0 con 0x7ff590091f60 2021-02-06T22:57:20.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff5800018f0 con 0x7ff590091f60 2021-02-06T22:57:20.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2798976500 0 0) 0x7ff590090830 con 0x7ff59008f510 2021-02-06T22:57:20.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff5900673c0 con 0x7ff59008f510 2021-02-06T22:57:20.104 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.090+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff578001be0 con 0x7ff59008f510 2021-02-06T22:57:20.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3759888897 0 0) 0x7ff590067120 con 0x7ff59012cd50 2021-02-06T22:57:20.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.106:6789/0 conn(0x7ff59008f510 legacy=0x7ff5901356c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.51:6789/0 conn(0x7ff590091f60 legacy=0x7ff59013a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.105 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590066880 con 0x7ff59012cd50 2021-02-06T22:57:20.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff590124d60 con 0x7ff59012cd50 2021-02-06T22:57:20.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff594966700 10 client.4793.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:20.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff590135f90 con 0x7ff59012cd50 2021-02-06T22:57:20.106 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff594966700 1 librados: init done 2021-02-06T22:57:20.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7ff588004c80 con 0x7ff59012cd50 2021-02-06T22:57:20.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7ff588004f90 con 0x7ff59012cd50 2021-02-06T22:57:20.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7ff5880051b0 con 0x7ff59012cd50 2021-02-06T22:57:20.107 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7ff588039900 con 0x7ff59012cd50 2021-02-06T22:57:20.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 10 client.4793.objecter ms_dispatch 0x7ff590001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:20.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 3 client.4793.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:20.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff586ffd700 3 client.4793.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:20.108 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.091+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff568004d60 con 0x7ff59012cd50 2021-02-06T22:57:20.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.092+0000 7ff586ffd700 20 client.4793.objecter dump_active .. 0 homeless 2021-02-06T22:57:20.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.094+0000 7ff586ffd700 10 client.4793.objecter ms_handle_connect 0x7ff5740307b0 2021-02-06T22:57:20.109 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.096+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7ff5880127f0 con 0x7ff59012cd50 2021-02-06T22:57:20.346 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.346+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff5680059b0 con 0x7ff59012cd50 2021-02-06T22:57:20.346 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.346+0000 7ff586ffd700 1 -- 172.21.15.51:0/1554146789 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7ff5880123e0 con 0x7ff59012cd50 2021-02-06T22:57:20.347 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:20.348 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 10 librados: watch_flush enter 2021-02-06T22:57:20.348 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 10 librados: watch_flush exit 2021-02-06T22:57:20.349 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 20 client.4793.objecter shutdown clearing up homeless session... 2021-02-06T22:57:20.349 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 10 client.4793.objecter successfully canceled tick 2021-02-06T22:57:20.349 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.106:6812/33219 conn(0x7ff5740307b0 legacy=0x7ff574032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.349 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 >> v1:172.21.15.51:6790/0 conn(0x7ff59012cd50 legacy=0x7ff59013dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:20.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 shutdown_connections 2021-02-06T22:57:20.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 >> 172.21.15.51:0/1554146789 conn(0x7ff590095be0 msgr2=0x7ff590127b00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:20.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 shutdown_connections 2021-02-06T22:57:20.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 -- 172.21.15.51:0/1554146789 wait complete. 2021-02-06T22:57:20.350 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:20.348+0000 7ff594966700 1 librados: shutdown 2021-02-06T22:57:20.359 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:23.360 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:23.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f41857c4700 1 Processor -- start 2021-02-06T22:57:23.496 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f41857c4700 1 -- start start 2021-02-06T22:57:23.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f41857c4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180095440 con 0x7f4180092bf0 2021-02-06T22:57:23.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f41857c4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800907b0 con 0x7f418012ce00 2021-02-06T22:57:23.497 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f41857c4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180091010 con 0x7f418008fa70 2021-02-06T22:57:23.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f417e7fc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4180092bf0 0x7f41800930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60920/0 (socket says 172.21.15.51:60920) 2021-02-06T22:57:23.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f417effd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f418008fa70 0x7f41800921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33034/0 (socket says 172.21.15.51:33034) 2021-02-06T22:57:23.498 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.496+0000 7f417e7fc700 1 -- 172.21.15.51:0/646377815 learned_addr learned my addr 172.21.15.51:0/646377815 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:23.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417effd700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.51:6790/0 conn(0x7f418008fa70 legacy=0x7f41800921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417e7fc700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.51:6789/0 conn(0x7f4180092bf0 legacy=0x7f41800930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.500 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417f7fe700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.106:6789/0 conn(0x7f418012ce00 legacy=0x7f418012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181028930 0 0) 0x7f4180091010 con 0x7f418008fa70 2021-02-06T22:57:23.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003230 con 0x7f418008fa70 2021-02-06T22:57:23.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402554510 0 0) 0x7f4180095440 con 0x7f4180092bf0 2021-02-06T22:57:23.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4180091010 con 0x7f4180092bf0 2021-02-06T22:57:23.501 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776502358 0 0) 0x7f41800907b0 con 0x7f418012ce00 2021-02-06T22:57:23.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4180095440 con 0x7f418012ce00 2021-02-06T22:57:23.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3071471309 0 0) 0x7f416c003230 con 0x7f418008fa70 2021-02-06T22:57:23.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.106:6789/0 conn(0x7f418012ce00 legacy=0x7f418012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.51:6789/0 conn(0x7f4180092bf0 legacy=0x7f41800930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.502 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800912b0 con 0x7f418008fa70 2021-02-06T22:57:23.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4170001930 con 0x7f418008fa70 2021-02-06T22:57:23.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4170001c40 con 0x7f418008fa70 2021-02-06T22:57:23.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.499+0000 7f417dffb700 1 -- 172.21.15.51:0/646377815 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4170004690 con 0x7f418008fa70 2021-02-06T22:57:23.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.500+0000 7f41857c4700 1 -- 172.21.15.51:0/646377815 >> v1:172.21.15.51:6790/0 conn(0x7f418008fa70 legacy=0x7f41800921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.503 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.500+0000 7f41857c4700 1 -- 172.21.15.51:0/646377815 shutdown_connections 2021-02-06T22:57:23.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.500+0000 7f41857c4700 1 -- 172.21.15.51:0/646377815 >> 172.21.15.51:0/646377815 conn(0x7f4180096860 msgr2=0x7f4180099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:23.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.500+0000 7f41857c4700 1 -- 172.21.15.51:0/646377815 shutdown_connections 2021-02-06T22:57:23.504 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.500+0000 7f41857c4700 1 -- 172.21.15.51:0/646377815 wait complete. 2021-02-06T22:57:23.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 librados: starting msgr at 2021-02-06T22:57:23.507 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 librados: starting objecter 2021-02-06T22:57:23.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 Processor -- start 2021-02-06T22:57:23.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 -- start start 2021-02-06T22:57:23.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 librados: setting wanted keys 2021-02-06T22:57:23.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 librados: calling monclient init 2021-02-06T22:57:23.508 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180130b50 con 0x7f418012ce00 2021-02-06T22:57:23.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41801240c0 con 0x7f418008fa70 2021-02-06T22:57:23.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f41857c4700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4180124360 con 0x7f4180092bf0 2021-02-06T22:57:23.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f417e7fc700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4180092bf0 0x7f4180130440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33038/0 (socket says 172.21.15.51:33038) 2021-02-06T22:57:23.509 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.501+0000 7f417e7fc700 1 -- 172.21.15.51:0/4023438017 learned_addr learned my addr 172.21.15.51:0/4023438017 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:23.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f417f7fe700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.51:6789/0 conn(0x7f418012ce00 legacy=0x7f418013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f417e7fc700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.51:6790/0 conn(0x7f4180092bf0 legacy=0x7f4180130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter ms_handle_connect 0x7f418012ce00 2021-02-06T22:57:23.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:23.510 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter ms_handle_connect 0x7f4180092bf0 2021-02-06T22:57:23.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:23.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter ms_handle_connect 0x7f418008fa70 2021-02-06T22:57:23.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:23.511 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f417effd700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.106:6789/0 conn(0x7f418008fa70 legacy=0x7f418012fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:23.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306856604 0 0) 0x7f4180130b50 con 0x7f418012ce00 2021-02-06T22:57:23.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4160004bd0 con 0x7f418012ce00 2021-02-06T22:57:23.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248536073 0 0) 0x7f4180124360 con 0x7f4180092bf0 2021-02-06T22:57:23.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4180130b50 con 0x7f4180092bf0 2021-02-06T22:57:23.512 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969759915 0 0) 0x7f41801240c0 con 0x7f418008fa70 2021-02-06T22:57:23.513 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4180124360 con 0x7f418008fa70 2021-02-06T22:57:23.513 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3859364764 0 0) 0x7f4160004bd0 con 0x7f418012ce00 2021-02-06T22:57:23.513 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f41801240c0 con 0x7f418012ce00 2021-02-06T22:57:23.513 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4178001f60 con 0x7f418012ce00 2021-02-06T22:57:23.513 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2875686172 0 0) 0x7f4180130b50 con 0x7f4180092bf0 2021-02-06T22:57:23.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4160004bd0 con 0x7f4180092bf0 2021-02-06T22:57:23.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4174001990 con 0x7f4180092bf0 2021-02-06T22:57:23.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 983795995 0 0) 0x7f4180124360 con 0x7f418008fa70 2021-02-06T22:57:23.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4180130b50 con 0x7f418008fa70 2021-02-06T22:57:23.514 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f41700018f0 con 0x7f418008fa70 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3427560032 0 0) 0x7f41801240c0 con 0x7f418012ce00 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.51:6790/0 conn(0x7f4180092bf0 legacy=0x7f4180130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.106:6789/0 conn(0x7f418008fa70 legacy=0x7f418012fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180131850 con 0x7f418012ce00 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801324f0 con 0x7f418012ce00 2021-02-06T22:57:23.515 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f41857c4700 10 client.4827.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:23.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801248e0 con 0x7f418012ce00 2021-02-06T22:57:23.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f41857c4700 1 librados: init done 2021-02-06T22:57:23.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f41780025b0 con 0x7f418012ce00 2021-02-06T22:57:23.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.504+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f41780028c0 con 0x7f418012ce00 2021-02-06T22:57:23.516 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4178002ae0 con 0x7f418012ce00 2021-02-06T22:57:23.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f41780398d0 con 0x7f418012ce00 2021-02-06T22:57:23.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 10 client.4827.objecter ms_dispatch 0x7f4180001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:23.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 3 client.4827.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:23.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 3 client.4827.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:23.517 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f4166ffd700 20 client.4827.objecter dump_active .. 0 homeless 2021-02-06T22:57:23.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.505+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158004d60 con 0x7f418012ce00 2021-02-06T22:57:23.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.508+0000 7f4166ffd700 10 client.4827.objecter ms_handle_connect 0x7f41600307b0 2021-02-06T22:57:23.518 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.509+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f41780127c0 con 0x7f418012ce00 2021-02-06T22:57:23.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.760+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f41580059b0 con 0x7f418012ce00 2021-02-06T22:57:23.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.760+0000 7f4166ffd700 1 -- 172.21.15.51:0/4023438017 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f41780123b0 con 0x7f418012ce00 2021-02-06T22:57:23.761 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 10 librados: watch_flush enter 2021-02-06T22:57:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 10 librados: watch_flush exit 2021-02-06T22:57:23.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 20 client.4827.objecter shutdown clearing up homeless session... 2021-02-06T22:57:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 10 client.4827.objecter successfully canceled tick 2021-02-06T22:57:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.106:6812/33219 conn(0x7f41600307b0 legacy=0x7f4160032c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 >> v1:172.21.15.51:6789/0 conn(0x7f418012ce00 legacy=0x7f418013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:23.763 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 shutdown_connections 2021-02-06T22:57:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 >> 172.21.15.51:0/4023438017 conn(0x7f4180096860 msgr2=0x7f4180093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 shutdown_connections 2021-02-06T22:57:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 -- 172.21.15.51:0/4023438017 wait complete. 2021-02-06T22:57:23.764 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:23.762+0000 7f41857c4700 1 librados: shutdown 2021-02-06T22:57:23.773 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:26.774 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:26.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cca1f5700 1 Processor -- start 2021-02-06T22:57:26.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cca1f5700 1 -- start start 2021-02-06T22:57:26.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cca1f5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4095050 con 0x7f4cc4067a30 2021-02-06T22:57:26.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cca1f5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4128c00 con 0x7f4cc40999a0 2021-02-06T22:57:26.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cca1f5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4095280 con 0x7f4cc4067ec0 2021-02-06T22:57:26.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cc2ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4cc4067a30 0x7f4cc412d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60934/0 (socket says 172.21.15.51:60934) 2021-02-06T22:57:26.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cc3fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 0x7f4cc4130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33048/0 (socket says 172.21.15.51:33048) 2021-02-06T22:57:26.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.912+0000 7f4cc2ffd700 1 -- 172.21.15.51:0/239090039 learned_addr learned my addr 172.21.15.51:0/239090039 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:26.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.914+0000 7f4cc3fff700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 legacy=0x7f4cc4130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.914+0000 7f4cc2ffd700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.51:6789/0 conn(0x7f4cc4067a30 legacy=0x7f4cc412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212103649 0 0) 0x7f4cc4095280 con 0x7f4cc4067ec0 2021-02-06T22:57:26.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cb0003230 con 0x7f4cc4067ec0 2021-02-06T22:57:26.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351404549 0 0) 0x7f4cc4095050 con 0x7f4cc4067a30 2021-02-06T22:57:26.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4095280 con 0x7f4cc4067a30 2021-02-06T22:57:26.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc37fe700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.106:6789/0 conn(0x7f4cc40999a0 legacy=0x7f4cc41284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992240821 0 0) 0x7f4cc4128c00 con 0x7f4cc40999a0 2021-02-06T22:57:26.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc4095050 con 0x7f4cc40999a0 2021-02-06T22:57:26.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2162903716 0 0) 0x7f4cb0003230 con 0x7f4cc4067ec0 2021-02-06T22:57:26.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.106:6789/0 conn(0x7f4cc40999a0 legacy=0x7f4cc41284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:26.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.51:6789/0 conn(0x7f4cc4067a30 legacy=0x7f4cc412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:26.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4095520 con 0x7f4cc4067ec0 2021-02-06T22:57:26.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cbc001cf0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4cbc001f80 con 0x7f4cc4067ec0 2021-02-06T22:57:26.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.915+0000 7f4cc27fc700 1 -- 172.21.15.51:0/239090039 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cbc004a10 con 0x7f4cc4067ec0 2021-02-06T22:57:26.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 -- 172.21.15.51:0/239090039 >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 legacy=0x7f4cc4130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:26.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 -- 172.21.15.51:0/239090039 shutdown_connections 2021-02-06T22:57:26.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 -- 172.21.15.51:0/239090039 >> 172.21.15.51:0/239090039 conn(0x7f4cc4096860 msgr2=0x7f4cc4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:26.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 -- 172.21.15.51:0/239090039 shutdown_connections 2021-02-06T22:57:26.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 -- 172.21.15.51:0/239090039 wait complete. 2021-02-06T22:57:26.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 librados: starting msgr at 2021-02-06T22:57:26.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.916+0000 7f4cca1f5700 1 librados: starting objecter 2021-02-06T22:57:26.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 Processor -- start 2021-02-06T22:57:26.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 -- start start 2021-02-06T22:57:26.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 librados: setting wanted keys 2021-02-06T22:57:26.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 librados: calling monclient init 2021-02-06T22:57:26.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc411bef0 con 0x7f4cc40999a0 2021-02-06T22:57:26.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc4093230 con 0x7f4cc4067a30 2021-02-06T22:57:26.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cca1f5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc411c2b0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cc2ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 0x7f4cc4090ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33052/0 (socket says 172.21.15.51:33052) 2021-02-06T22:57:26.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cc3fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4cc40999a0 0x7f4cc4146660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60944/0 (socket says 172.21.15.51:60944) 2021-02-06T22:57:26.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.917+0000 7f4cc2ffd700 1 -- 172.21.15.51:0/325923950 learned_addr learned my addr 172.21.15.51:0/325923950 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:26.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.919+0000 7f4cc2ffd700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 legacy=0x7f4cc4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cc3fff700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.51:6789/0 conn(0x7f4cc40999a0 legacy=0x7f4cc4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter ms_handle_connect 0x7f4cc4067ec0 2021-02-06T22:57:26.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:26.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter ms_handle_connect 0x7f4cc40999a0 2021-02-06T22:57:26.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:26.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter ms_handle_connect 0x7f4cc4067a30 2021-02-06T22:57:26.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:26.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cc37fe700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.106:6789/0 conn(0x7f4cc4067a30 legacy=0x7f4cc40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:26.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566734842 0 0) 0x7f4cc411c2b0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca4004bd0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271061304 0 0) 0x7f4cc411bef0 con 0x7f4cc40999a0 2021-02-06T22:57:26.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc411c2b0 con 0x7f4cc40999a0 2021-02-06T22:57:26.928 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728037969 0 0) 0x7f4cc4093230 con 0x7f4cc4067a30 2021-02-06T22:57:26.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc411bef0 con 0x7f4cc4067a30 2021-02-06T22:57:26.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 72323744 0 0) 0x7f4ca4004bd0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4cc4093230 con 0x7f4cc4067ec0 2021-02-06T22:57:26.929 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cb8001990 con 0x7f4cc4067ec0 2021-02-06T22:57:26.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3028266676 0 0) 0x7f4cc411c2b0 con 0x7f4cc40999a0 2021-02-06T22:57:26.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4ca4004bd0 con 0x7f4cc40999a0 2021-02-06T22:57:26.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cbc001cb0 con 0x7f4cc40999a0 2021-02-06T22:57:26.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 763386667 0 0) 0x7f4cc411bef0 con 0x7f4cc4067a30 2021-02-06T22:57:26.930 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4cc411c2b0 con 0x7f4cc4067a30 2021-02-06T22:57:26.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cb4001be0 con 0x7f4cc4067a30 2021-02-06T22:57:26.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 460187295 0 0) 0x7f4cc4093230 con 0x7f4cc4067ec0 2021-02-06T22:57:26.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.106:6789/0 conn(0x7f4cc4067a30 legacy=0x7f4cc40907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:26.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.51:6789/0 conn(0x7f4cc40999a0 legacy=0x7f4cc4146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:26.931 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc4121a00 con 0x7f4cc4067ec0 2021-02-06T22:57:26.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc411bb20 con 0x7f4cc4067ec0 2021-02-06T22:57:26.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cca1f5700 10 client.4805.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:26.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc4131d60 con 0x7f4cc4067ec0 2021-02-06T22:57:26.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cca1f5700 1 librados: init done 2021-02-06T22:57:26.932 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4cb8004960 con 0x7f4cc4067ec0 2021-02-06T22:57:26.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.920+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4cb8004c70 con 0x7f4cc4067ec0 2021-02-06T22:57:26.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f4cb8004e50 con 0x7f4cc4067ec0 2021-02-06T22:57:26.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f4cb80395f0 con 0x7f4cc4067ec0 2021-02-06T22:57:26.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 10 client.4805.objecter ms_dispatch 0x7f4cc4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:26.933 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 3 client.4805.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:26.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 3 client.4805.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:26.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9c004d60 con 0x7f4cc4067ec0 2021-02-06T22:57:26.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.921+0000 7f4cab7fe700 20 client.4805.objecter dump_active .. 0 homeless 2021-02-06T22:57:26.934 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.924+0000 7f4cab7fe700 10 client.4805.objecter ms_handle_connect 0x7f4ca4030850 2021-02-06T22:57:26.935 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:26.925+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f4cb80124e0 con 0x7f4cc4067ec0 2021-02-06T22:57:27.175 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.176+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c9c0059b0 con 0x7f4cc4067ec0 2021-02-06T22:57:27.320 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.176+0000 7f4cab7fe700 1 -- 172.21.15.51:0/325923950 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7f4cb80120d0 con 0x7f4cc4067ec0 2021-02-06T22:57:27.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 10 librados: watch_flush enter 2021-02-06T22:57:27.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 10 librados: watch_flush exit 2021-02-06T22:57:27.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 20 client.4805.objecter shutdown clearing up homeless session... 2021-02-06T22:57:27.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 10 client.4805.objecter successfully canceled tick 2021-02-06T22:57:27.321 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.106:6812/33219 conn(0x7f4ca4030850 legacy=0x7f4ca4032d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:27.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 >> v1:172.21.15.51:6790/0 conn(0x7f4cc4067ec0 legacy=0x7f4cc4090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:27.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 shutdown_connections 2021-02-06T22:57:27.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 >> 172.21.15.51:0/325923950 conn(0x7f4cc4096860 msgr2=0x7f4cc4126120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:27.322 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 shutdown_connections 2021-02-06T22:57:27.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 -- 172.21.15.51:0/325923950 wait complete. 2021-02-06T22:57:27.323 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:27.178+0000 7f4cca1f5700 1 librados: shutdown 2021-02-06T22:57:27.323 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:27.323 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:30.325 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2021-02-06T22:57:30.459 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.460+0000 7efcf49d2700 1 Processor -- start 2021-02-06T22:57:30.460 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.460+0000 7efcf49d2700 1 -- start start 2021-02-06T22:57:30.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcf49d2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0095440 con 0x7efcf0092bf0 2021-02-06T22:57:30.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcf49d2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00907b0 con 0x7efcf012ce00 2021-02-06T22:57:30.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcf49d2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0091010 con 0x7efcf008fa70 2021-02-06T22:57:30.461 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcedd9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 0x7efcf00930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60950/0 (socket says 172.21.15.51:60950) 2021-02-06T22:57:30.462 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcedd9b700 1 -- 172.21.15.51:0/2438735999 learned_addr learned my addr 172.21.15.51:0/2438735999 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:30.462 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.461+0000 7efcee59c700 1 --1- 172.21.15.51:0/2438735999 >> v1:172.21.15.51:6790/0 conn(0x7efcf008fa70 0x7efcf00921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33058/0 (socket says 172.21.15.51:33058) 2021-02-06T22:57:30.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efcee59c700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.51:6790/0 conn(0x7efcf008fa70 legacy=0x7efcf00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efcedd9b700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 legacy=0x7efcf00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.465 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efceed9d700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.106:6789/0 conn(0x7efcf012ce00 legacy=0x7efcf012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440190495 0 0) 0x7efcf0091010 con 0x7efcf008fa70 2021-02-06T22:57:30.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd4003230 con 0x7efcf008fa70 2021-02-06T22:57:30.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370650548 0 0) 0x7efcf0095440 con 0x7efcf0092bf0 2021-02-06T22:57:30.466 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0091010 con 0x7efcf0092bf0 2021-02-06T22:57:30.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213834384 0 0) 0x7efcf00907b0 con 0x7efcf012ce00 2021-02-06T22:57:30.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.463+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0095440 con 0x7efcf012ce00 2021-02-06T22:57:30.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 649043772 0 0) 0x7efcd4003230 con 0x7efcf008fa70 2021-02-06T22:57:30.467 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.106:6789/0 conn(0x7efcf012ce00 legacy=0x7efcf012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 legacy=0x7efcf00930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00912b0 con 0x7efcf008fa70 2021-02-06T22:57:30.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce0001930 con 0x7efcf008fa70 2021-02-06T22:57:30.468 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efce0001c40 con 0x7efcf008fa70 2021-02-06T22:57:30.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efced59a700 1 -- 172.21.15.51:0/2438735999 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce0004690 con 0x7efcf008fa70 2021-02-06T22:57:30.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efcf49d2700 1 -- 172.21.15.51:0/2438735999 >> v1:172.21.15.51:6790/0 conn(0x7efcf008fa70 legacy=0x7efcf00921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efcf49d2700 1 -- 172.21.15.51:0/2438735999 shutdown_connections 2021-02-06T22:57:30.469 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efcf49d2700 1 -- 172.21.15.51:0/2438735999 >> 172.21.15.51:0/2438735999 conn(0x7efcf0096860 msgr2=0x7efcf0099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:30.470 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efcf49d2700 1 -- 172.21.15.51:0/2438735999 shutdown_connections 2021-02-06T22:57:30.470 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.464+0000 7efcf49d2700 1 -- 172.21.15.51:0/2438735999 wait complete. 2021-02-06T22:57:30.470 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 librados: starting msgr at 2021-02-06T22:57:30.470 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 librados: starting objecter 2021-02-06T22:57:30.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 Processor -- start 2021-02-06T22:57:30.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 -- start start 2021-02-06T22:57:30.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 librados: setting wanted keys 2021-02-06T22:57:30.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.465+0000 7efcf49d2700 1 librados: calling monclient init 2021-02-06T22:57:30.471 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.466+0000 7efcf49d2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0130b50 con 0x7efcf0092bf0 2021-02-06T22:57:30.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.466+0000 7efcf49d2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf01240c0 con 0x7efcf008fa70 2021-02-06T22:57:30.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.466+0000 7efcf49d2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf0124360 con 0x7efcf012ce00 2021-02-06T22:57:30.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.466+0000 7efcedd9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 0x7efcf0130440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60956/0 (socket says 172.21.15.51:60956) 2021-02-06T22:57:30.472 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.466+0000 7efcedd9b700 1 -- 172.21.15.51:0/3639011380 learned_addr learned my addr 172.21.15.51:0/3639011380 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:30.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efceed9d700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.51:6790/0 conn(0x7efcf012ce00 legacy=0x7efcf013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter ms_handle_connect 0x7efcf012ce00 2021-02-06T22:57:30.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.476 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter ms_handle_connect 0x7efcf0092bf0 2021-02-06T22:57:30.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcedd9b700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 legacy=0x7efcf0130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677307670 0 0) 0x7efcf0124360 con 0x7efcf012ce00 2021-02-06T22:57:30.477 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcee59c700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.106:6789/0 conn(0x7efcf008fa70 legacy=0x7efcf012fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efccc004bd0 con 0x7efcf012ce00 2021-02-06T22:57:30.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter ms_handle_connect 0x7efcf008fa70 2021-02-06T22:57:30.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.478 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950994787 0 0) 0x7efcf0130b50 con 0x7efcf0092bf0 2021-02-06T22:57:30.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0124360 con 0x7efcf0092bf0 2021-02-06T22:57:30.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934433915 0 0) 0x7efcf01240c0 con 0x7efcf008fa70 2021-02-06T22:57:30.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf0130b50 con 0x7efcf008fa70 2021-02-06T22:57:30.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3302226454 0 0) 0x7efcf0124360 con 0x7efcf0092bf0 2021-02-06T22:57:30.479 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcf01240c0 con 0x7efcf0092bf0 2021-02-06T22:57:30.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce4001990 con 0x7efcf0092bf0 2021-02-06T22:57:30.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3416385848 0 0) 0x7efccc004bd0 con 0x7efcf012ce00 2021-02-06T22:57:30.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efcf0124360 con 0x7efcf012ce00 2021-02-06T22:57:30.480 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce8001f60 con 0x7efcf012ce00 2021-02-06T22:57:30.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4075186274 0 0) 0x7efcf0130b50 con 0x7efcf008fa70 2021-02-06T22:57:30.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efccc004bd0 con 0x7efcf008fa70 2021-02-06T22:57:30.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.468+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce00018f0 con 0x7efcf008fa70 2021-02-06T22:57:30.481 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2970922548 0 0) 0x7efcf01240c0 con 0x7efcf0092bf0 2021-02-06T22:57:30.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.51:6790/0 conn(0x7efcf012ce00 legacy=0x7efcf013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.106:6789/0 conn(0x7efcf008fa70 legacy=0x7efcf012fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0131850 con 0x7efcf0092bf0 2021-02-06T22:57:30.482 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3015815391 0 0) 0x7efcf0124360 con 0x7efcf012ce00 2021-02-06T22:57:30.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf01324f0 con 0x7efcf0092bf0 2021-02-06T22:57:30.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcf49d2700 10 client.4839.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:30.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf01248e0 con 0x7efcf0092bf0 2021-02-06T22:57:30.483 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcf49d2700 1 librados: init done 2021-02-06T22:57:30.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7efce4004960 con 0x7efcf0092bf0 2021-02-06T22:57:30.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7efce4004c70 con 0x7efcf0092bf0 2021-02-06T22:57:30.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.469+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7efce4004e50 con 0x7efcf0092bf0 2021-02-06T22:57:30.484 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7efce4039620 con 0x7efcf0092bf0 2021-02-06T22:57:30.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcde7fc700 10 client.4839.objecter ms_dispatch 0x7efcf0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:30.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcde7fc700 3 client.4839.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:30.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcde7fc700 3 client.4839.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:30.485 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf00581b0 con 0x7efcf0092bf0 2021-02-06T22:57:30.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.470+0000 7efcde7fc700 20 client.4839.objecter dump_active .. 0 homeless 2021-02-06T22:57:30.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.472+0000 7efcde7fc700 10 client.4839.objecter ms_handle_connect 0x7efccc030740 2021-02-06T22:57:30.486 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.474+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7efce4012510 con 0x7efcf0092bf0 2021-02-06T22:57:30.723 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.724+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efcf0124b90 con 0x7efcf0092bf0 2021-02-06T22:57:30.724 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.724+0000 7efcde7fc700 1 -- 172.21.15.51:0/3639011380 <== mon.0 v1:172.21.15.51:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+199 (unknown 3730786198 0 397734676) 0x7efce4012100 con 0x7efcf0092bf0 2021-02-06T22:57:30.724 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:30.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.725+0000 7efcf49d2700 10 librados: watch_flush enter 2021-02-06T22:57:30.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 10 librados: watch_flush exit 2021-02-06T22:57:30.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 20 client.4839.objecter shutdown clearing up homeless session... 2021-02-06T22:57:30.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 10 client.4839.objecter successfully canceled tick 2021-02-06T22:57:30.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.106:6812/33219 conn(0x7efccc030740 legacy=0x7efccc032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 >> v1:172.21.15.51:6789/0 conn(0x7efcf0092bf0 legacy=0x7efcf0130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 shutdown_connections 2021-02-06T22:57:30.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 >> 172.21.15.51:0/3639011380 conn(0x7efcf0096860 msgr2=0x7efcf0093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:30.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 shutdown_connections 2021-02-06T22:57:30.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 -- 172.21.15.51:0/3639011380 wait complete. 2021-02-06T22:57:30.728 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.726+0000 7efcf49d2700 1 librados: shutdown 2021-02-06T22:57:30.736 INFO:teuthology.orchestra.run.smithi051.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'devicehealth' has failed: name 'cast' is not defined","count":1},"muted":false}},"mutes":[]} 2021-02-06T22:57:30.736 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2021-02-06T22:57:30.737 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-06T22:57:30.859 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.860+0000 7f455896c700 1 Processor -- start 2021-02-06T22:57:30.860 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.860+0000 7f455896c700 1 -- start start 2021-02-06T22:57:30.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f455896c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455409b0b0 con 0x7f4554091b90 2021-02-06T22:57:30.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f455896c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4554092ca0 con 0x7f4554130a80 2021-02-06T22:57:30.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f455896c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45540992d0 con 0x7f45540917b0 2021-02-06T22:57:30.861 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f455259c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f45540917b0 0x7f4554093560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33072/0 (socket says 172.21.15.51:33072) 2021-02-06T22:57:30.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f4551d9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f4554091b90 0x7f4554092040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60964/0 (socket says 172.21.15.51:60964) 2021-02-06T22:57:30.862 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.861+0000 7f455259c700 1 -- 172.21.15.51:0/2893605848 learned_addr learned my addr 172.21.15.51:0/2893605848 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:30.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.863+0000 7f455259c700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.51:6790/0 conn(0x7f45540917b0 legacy=0x7f4554093560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.864 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.863+0000 7f4551d9b700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.51:6789/0 conn(0x7f4554091b90 legacy=0x7f4554092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.863+0000 7f4552d9d700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.106:6789/0 conn(0x7f4554130a80 legacy=0x7f4554132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.863+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128476574 0 0) 0x7f45540992d0 con 0x7f45540917b0 2021-02-06T22:57:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4538003230 con 0x7f45540917b0 2021-02-06T22:57:30.865 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630212104 0 0) 0x7f455409b0b0 con 0x7f4554091b90 2021-02-06T22:57:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45540992d0 con 0x7f4554091b90 2021-02-06T22:57:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250561760 0 0) 0x7f4554092ca0 con 0x7f4554130a80 2021-02-06T22:57:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455409b0b0 con 0x7f4554130a80 2021-02-06T22:57:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 240204950 0 0) 0x7f4538003230 con 0x7f45540917b0 2021-02-06T22:57:30.866 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.106:6789/0 conn(0x7f4554130a80 legacy=0x7f4554132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.51:6789/0 conn(0x7f4554091b90 legacy=0x7f4554092040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554099460 con 0x7f45540917b0 2021-02-06T22:57:30.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4544001960 con 0x7f45540917b0 2021-02-06T22:57:30.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2143837651 0 0) 0x7f45540992d0 con 0x7f4554091b90 2021-02-06T22:57:30.867 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4548001860 con 0x7f4554091b90 2021-02-06T22:57:30.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4544001c70 con 0x7f45540917b0 2021-02-06T22:57:30.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455159a700 1 -- 172.21.15.51:0/2893605848 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4544004750 con 0x7f45540917b0 2021-02-06T22:57:30.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455896c700 1 -- 172.21.15.51:0/2893605848 >> v1:172.21.15.51:6790/0 conn(0x7f45540917b0 legacy=0x7f4554093560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.868 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455896c700 1 -- 172.21.15.51:0/2893605848 shutdown_connections 2021-02-06T22:57:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.864+0000 7f455896c700 1 -- 172.21.15.51:0/2893605848 >> 172.21.15.51:0/2893605848 conn(0x7f455409e2a0 msgr2=0x7f455409a200 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 -- 172.21.15.51:0/2893605848 shutdown_connections 2021-02-06T22:57:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 -- 172.21.15.51:0/2893605848 wait complete. 2021-02-06T22:57:30.869 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 librados: starting msgr at 2021-02-06T22:57:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 librados: starting objecter 2021-02-06T22:57:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 Processor -- start 2021-02-06T22:57:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 -- start start 2021-02-06T22:57:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 librados: setting wanted keys 2021-02-06T22:57:30.870 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.865+0000 7f455896c700 1 librados: calling monclient init 2021-02-06T22:57:30.873 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.866+0000 7f455896c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4554085930 con 0x7f4554130a80 2021-02-06T22:57:30.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.866+0000 7f455896c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4554084e70 con 0x7f45540917b0 2021-02-06T22:57:30.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.866+0000 7f455896c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45540861f0 con 0x7f4554091b90 2021-02-06T22:57:30.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.866+0000 7f4551d9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f4554091b90 0x7f45540909d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33080/0 (socket says 172.21.15.51:33080) 2021-02-06T22:57:30.874 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.866+0000 7f4551d9b700 1 -- 172.21.15.51:0/3328256946 learned_addr learned my addr 172.21.15.51:0/3328256946 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:30.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f4552d9d700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.51:6789/0 conn(0x7f4554130a80 legacy=0x7f4554141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter ms_handle_connect 0x7f4554130a80 2021-02-06T22:57:30.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f455259c700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.106:6789/0 conn(0x7f45540917b0 legacy=0x7f45541399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.875 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter ms_handle_connect 0x7f45540917b0 2021-02-06T22:57:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter ms_handle_connect 0x7f4554091b90 2021-02-06T22:57:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f4551d9b700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.51:6790/0 conn(0x7f4554091b90 legacy=0x7f45540909d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:30.876 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.868+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900851623 0 0) 0x7f4554084e70 con 0x7f45540917b0 2021-02-06T22:57:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4530004bd0 con 0x7f45540917b0 2021-02-06T22:57:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776492360 0 0) 0x7f4554085930 con 0x7f4554130a80 2021-02-06T22:57:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4554084e70 con 0x7f4554130a80 2021-02-06T22:57:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288899193 0 0) 0x7f45540861f0 con 0x7f4554091b90 2021-02-06T22:57:30.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4554085930 con 0x7f4554091b90 2021-02-06T22:57:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3628817223 0 0) 0x7f4530004bd0 con 0x7f45540917b0 2021-02-06T22:57:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f45540861f0 con 0x7f45540917b0 2021-02-06T22:57:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4544001920 con 0x7f45540917b0 2021-02-06T22:57:30.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1165815328 0 0) 0x7f4554084e70 con 0x7f4554130a80 2021-02-06T22:57:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4530004bd0 con 0x7f4554130a80 2021-02-06T22:57:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1379059931 0 0) 0x7f4554085930 con 0x7f4554091b90 2021-02-06T22:57:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4554084e70 con 0x7f4554091b90 2021-02-06T22:57:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f454c001f60 con 0x7f4554130a80 2021-02-06T22:57:30.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4548001d30 con 0x7f4554091b90 2021-02-06T22:57:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 437442292 0 0) 0x7f45540861f0 con 0x7f45540917b0 2021-02-06T22:57:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.51:6790/0 conn(0x7f4554091b90 legacy=0x7f45540909d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.51:6789/0 conn(0x7f4554130a80 legacy=0x7f4554141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554086490 con 0x7f45540917b0 2021-02-06T22:57:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455413a120 con 0x7f45540917b0 2021-02-06T22:57:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f455896c700 10 client.4828.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f45540912a0 con 0x7f45540917b0 2021-02-06T22:57:30.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f455896c700 1 librados: init done 2021-02-06T22:57:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f4544004cc0 con 0x7f45540917b0 2021-02-06T22:57:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.869+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f4544004e30 con 0x7f45540917b0 2021-02-06T22:57:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f454400d5f0 con 0x7f45540917b0 2021-02-06T22:57:30.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4534004d60 con 0x7f45540917b0 2021-02-06T22:57:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f4544039510 con 0x7f45540917b0 2021-02-06T22:57:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 10 client.4828.objecter ms_dispatch 0x7f4554001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 3 client.4828.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 3 client.4828.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:30.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.870+0000 7f45427fc700 20 client.4828.objecter dump_active .. 0 homeless 2021-02-06T22:57:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.873+0000 7f45427fc700 10 client.4828.objecter ms_handle_connect 0x7f4530030950 2021-02-06T22:57:30.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:30.875+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f45440121e0 con 0x7f45540917b0 2021-02-06T22:57:31.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.056+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4534005430 con 0x7f45540917b0 2021-02-06T22:57:31.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.057+0000 7f45427fc700 1 -- 172.21.15.51:0/3328256946 <== mon.1 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8441 (unknown 4221056075 0 3964562250) 0x7f4544012000 con 0x7f45540917b0 2021-02-06T22:57:31.057 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:31.057 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":15,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:23.220212+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-06T22:52:20.713249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:57:31.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.058+0000 7f455896c700 10 librados: watch_flush enter 2021-02-06T22:57:31.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 10 librados: watch_flush exit 2021-02-06T22:57:31.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 20 client.4828.objecter shutdown clearing up homeless session... 2021-02-06T22:57:31.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 10 client.4828.objecter successfully canceled tick 2021-02-06T22:57:31.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.106:6812/33219 conn(0x7f4530030950 legacy=0x7f4530032e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 >> v1:172.21.15.106:6789/0 conn(0x7f45540917b0 legacy=0x7f45541399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 shutdown_connections 2021-02-06T22:57:31.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 >> 172.21.15.51:0/3328256946 conn(0x7f455409e2a0 msgr2=0x7f4554132e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:31.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 shutdown_connections 2021-02-06T22:57:31.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 -- 172.21.15.51:0/3328256946 wait complete. 2021-02-06T22:57:31.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.059+0000 7f455896c700 1 librados: shutdown 2021-02-06T22:57:31.069 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-06T22:57:31.192 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae5a25e700 1 Processor -- start 2021-02-06T22:57:31.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae5a25e700 1 -- start start 2021-02-06T22:57:31.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae5a25e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae54095440 con 0x7fae5408fa70 2021-02-06T22:57:31.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae5a25e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540907b0 con 0x7fae54092bf0 2021-02-06T22:57:31.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae5a25e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae54091010 con 0x7fae5412ce00 2021-02-06T22:57:31.193 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae537fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 0x7fae540921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60976/0 (socket says 172.21.15.51:60976) 2021-02-06T22:57:31.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae53fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fae5412ce00 0x7fae5412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33090/0 (socket says 172.21.15.51:33090) 2021-02-06T22:57:31.194 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.193+0000 7fae537fe700 1 -- 172.21.15.51:0/1511853280 learned_addr learned my addr 172.21.15.51:0/1511853280 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:31.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.195+0000 7fae53fff700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.51:6790/0 conn(0x7fae5412ce00 legacy=0x7fae5412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.195+0000 7fae537fe700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 legacy=0x7fae540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451802034 0 0) 0x7fae54091010 con 0x7fae5412ce00 2021-02-06T22:57:31.196 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae40003230 con 0x7fae5412ce00 2021-02-06T22:57:31.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628598290 0 0) 0x7fae54095440 con 0x7fae5408fa70 2021-02-06T22:57:31.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54091010 con 0x7fae5408fa70 2021-02-06T22:57:31.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae52ffd700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.106:6789/0 conn(0x7fae54092bf0 legacy=0x7fae540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 947613769 0 0) 0x7fae40003230 con 0x7fae5412ce00 2021-02-06T22:57:31.197 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.106:6789/0 conn(0x7fae54092bf0 legacy=0x7fae540930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.198 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 legacy=0x7fae540921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.198 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540912b0 con 0x7fae5412ce00 2021-02-06T22:57:31.198 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae4c001cb0 con 0x7fae5412ce00 2021-02-06T22:57:31.198 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae53fff700 1 --1- 172.21.15.51:0/1511853280 >> v1:172.21.15.51:6790/0 conn(0x7fae5412ce00 0x7fae5412f1f0 :-1 s=OPENED pgs=311 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7fae4c004a10 mon_map magic: 0 v1 2021-02-06T22:57:31.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae4c001fc0 con 0x7fae5412ce00 2021-02-06T22:57:31.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae5a25e700 1 -- 172.21.15.51:0/1511853280 >> v1:172.21.15.51:6790/0 conn(0x7fae5412ce00 legacy=0x7fae5412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.196+0000 7fae527fc700 1 -- 172.21.15.51:0/1511853280 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae4c004a10 con 0x7fae5412ce00 2021-02-06T22:57:31.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 -- 172.21.15.51:0/1511853280 shutdown_connections 2021-02-06T22:57:31.199 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 -- 172.21.15.51:0/1511853280 >> 172.21.15.51:0/1511853280 conn(0x7fae54096860 msgr2=0x7fae54099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:31.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 -- 172.21.15.51:0/1511853280 shutdown_connections 2021-02-06T22:57:31.200 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 -- 172.21.15.51:0/1511853280 wait complete. 2021-02-06T22:57:31.203 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 librados: starting msgr at 2021-02-06T22:57:31.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.197+0000 7fae5a25e700 1 librados: starting objecter 2021-02-06T22:57:31.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 Processor -- start 2021-02-06T22:57:31.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 -- start start 2021-02-06T22:57:31.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 librados: setting wanted keys 2021-02-06T22:57:31.204 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 librados: calling monclient init 2021-02-06T22:57:31.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae54097ce0 con 0x7fae5408fa70 2021-02-06T22:57:31.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae541123f0 con 0x7fae5412ce00 2021-02-06T22:57:31.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae5a25e700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae54132b80 con 0x7fae54092bf0 2021-02-06T22:57:31.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae537fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 0x7fae5410fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60982/0 (socket says 172.21.15.51:60982) 2021-02-06T22:57:31.205 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae537fe700 1 -- 172.21.15.51:0/4274378229 learned_addr learned my addr 172.21.15.51:0/4274378229 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:31.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.198+0000 7fae52ffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fae54092bf0 0x7fae5413cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33094/0 (socket says 172.21.15.51:33094) 2021-02-06T22:57:31.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae52ffd700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.51:6790/0 conn(0x7fae54092bf0 legacy=0x7fae5413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae537fe700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 legacy=0x7fae5410fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.206 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter ms_handle_connect 0x7fae54092bf0 2021-02-06T22:57:31.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter ms_handle_connect 0x7fae5408fa70 2021-02-06T22:57:31.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae53fff700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.106:6789/0 conn(0x7fae5412ce00 legacy=0x7fae541402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.207 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492122926 0 0) 0x7fae54132b80 con 0x7fae54092bf0 2021-02-06T22:57:31.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae34004bd0 con 0x7fae54092bf0 2021-02-06T22:57:31.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter ms_handle_connect 0x7fae5412ce00 2021-02-06T22:57:31.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3225302541 0 0) 0x7fae54097ce0 con 0x7fae5408fa70 2021-02-06T22:57:31.208 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.200+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54132b80 con 0x7fae5408fa70 2021-02-06T22:57:31.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3221846308 0 0) 0x7fae541123f0 con 0x7fae5412ce00 2021-02-06T22:57:31.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae54097ce0 con 0x7fae5412ce00 2021-02-06T22:57:31.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1241050536 0 0) 0x7fae34004bd0 con 0x7fae54092bf0 2021-02-06T22:57:31.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae541123f0 con 0x7fae54092bf0 2021-02-06T22:57:31.209 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae48001bf0 con 0x7fae54092bf0 2021-02-06T22:57:31.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2485778639 0 0) 0x7fae54132b80 con 0x7fae5408fa70 2021-02-06T22:57:31.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae34004bd0 con 0x7fae5408fa70 2021-02-06T22:57:31.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae44001c60 con 0x7fae5408fa70 2021-02-06T22:57:31.210 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1568661674 0 0) 0x7fae541123f0 con 0x7fae54092bf0 2021-02-06T22:57:31.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.106:6789/0 conn(0x7fae5412ce00 legacy=0x7fae541402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.51:6789/0 conn(0x7fae5408fa70 legacy=0x7fae5410fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54132160 con 0x7fae54092bf0 2021-02-06T22:57:31.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae4c001660 con 0x7fae5412ce00 2021-02-06T22:57:31.211 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae54110d60 con 0x7fae54092bf0 2021-02-06T22:57:31.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae5a25e700 10 client.4823.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:31.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fae54110570 con 0x7fae54092bf0 2021-02-06T22:57:31.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae5a25e700 1 librados: init done 2021-02-06T22:57:31.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fae480022a0 con 0x7fae54092bf0 2021-02-06T22:57:31.212 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.201+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fae480025b0 con 0x7fae54092bf0 2021-02-06T22:57:31.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fae480027c0 con 0x7fae54092bf0 2021-02-06T22:57:31.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fae480394c0 con 0x7fae54092bf0 2021-02-06T22:57:31.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 10 client.4823.objecter ms_dispatch 0x7fae54001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:31.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 3 client.4823.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:31.213 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 3 client.4823.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:31.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae3b7fe700 20 client.4823.objecter dump_active .. 0 homeless 2021-02-06T22:57:31.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.202+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c004d60 con 0x7fae54092bf0 2021-02-06T22:57:31.214 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.204+0000 7fae3b7fe700 10 client.4823.objecter ms_handle_connect 0x7fae340303c0 2021-02-06T22:57:31.215 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.206+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fae480123b0 con 0x7fae54092bf0 2021-02-06T22:57:31.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.386+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae2c000b50 con 0x7fae340303c0 2021-02-06T22:57:31.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.389+0000 7fae3b7fe700 1 -- 172.21.15.51:0/4274378229 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+45895 (unknown 2965378022 0 4200149927) 0x7fae2c000b50 con 0x7fae340303c0 2021-02-06T22:57:31.388 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:31.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 10 librados: watch_flush enter 2021-02-06T22:57:31.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 10 librados: watch_flush exit 2021-02-06T22:57:31.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 20 client.4823.objecter shutdown clearing up homeless session... 2021-02-06T22:57:31.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 10 client.4823.objecter successfully canceled tick 2021-02-06T22:57:31.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.106:6812/33219 conn(0x7fae340303c0 legacy=0x7fae34032880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 >> v1:172.21.15.51:6790/0 conn(0x7fae54092bf0 legacy=0x7fae5413cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 shutdown_connections 2021-02-06T22:57:31.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 >> 172.21.15.51:0/4274378229 conn(0x7fae54096860 msgr2=0x7fae54093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:31.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 shutdown_connections 2021-02-06T22:57:31.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 -- 172.21.15.51:0/4274378229 wait complete. 2021-02-06T22:57:31.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.390+0000 7fae5a25e700 1 librados: shutdown 2021-02-06T22:57:31.392 INFO:teuthology.orchestra.run.smithi051.stderr:dumped all 2021-02-06T22:57:31.401 INFO:teuthology.orchestra.run.smithi051.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2021-02-06T22:57:30.697141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29360,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":28544,"kb_avail":566201680,"statfs":{"total":579820584960,"available":579790520320,"internally_reserved":0,"allocated":786432,"data_stored":215898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29229056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.219402+0000","last_change":"2021-02-06T22:52:22.218463+0000","last_active":"2021-02-06T22:52:22.219402+0000","last_peered":"2021-02-06T22:52:22.219402+0000","last_clean":"2021-02-06T22:52:22.219402+0000","last_became_active":"2021-02-06T22:52:22.218086+0000","last_became_peered":"2021-02-06T22:52:22.218086+0000","last_unstale":"2021-02-06T22:52:22.219402+0000","last_undegraded":"2021-02-06T22:52:22.219402+0000","last_fullsized":"2021-02-06T22:52:22.219402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220742+0000","last_change":"2021-02-06T22:52:22.219017+0000","last_active":"2021-02-06T22:52:22.220742+0000","last_peered":"2021-02-06T22:52:22.220742+0000","last_clean":"2021-02-06T22:52:22.220742+0000","last_became_active":"2021-02-06T22:52:22.218649+0000","last_became_peered":"2021-02-06T22:52:22.218649+0000","last_unstale":"2021-02-06T22:52:22.220742+0000","last_undegraded":"2021-02-06T22:52:22.220742+0000","last_fullsized":"2021-02-06T22:52:22.220742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.218366+0000","last_change":"2021-02-06T22:52:22.217659+0000","last_active":"2021-02-06T22:52:22.218366+0000","last_peered":"2021-02-06T22:52:22.218366+0000","last_clean":"2021-02-06T22:52:22.218366+0000","last_became_active":"2021-02-06T22:52:22.217295+0000","last_became_peered":"2021-02-06T22:52:22.217295+0000","last_unstale":"2021-02-06T22:52:22.218366+0000","last_undegraded":"2021-02-06T22:52:22.218366+0000","last_fullsized":"2021-02-06T22:52:22.218366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.438893+0000","last_change":"2021-02-06T22:52:22.438354+0000","last_active":"2021-02-06T22:52:22.438893+0000","last_peered":"2021-02-06T22:52:22.438893+0000","last_clean":"2021-02-06T22:52:22.438893+0000","last_became_active":"2021-02-06T22:52:22.438107+0000","last_became_peered":"2021-02-06T22:52:22.438107+0000","last_unstale":"2021-02-06T22:52:22.438893+0000","last_undegraded":"2021-02-06T22:52:22.438893+0000","last_fullsized":"2021-02-06T22:52:22.438893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221398+0000","last_change":"2021-02-06T22:52:22.220454+0000","last_active":"2021-02-06T22:52:22.221398+0000","last_peered":"2021-02-06T22:52:22.221398+0000","last_clean":"2021-02-06T22:52:22.221398+0000","last_became_active":"2021-02-06T22:52:22.220155+0000","last_became_peered":"2021-02-06T22:52:22.220155+0000","last_unstale":"2021-02-06T22:52:22.221398+0000","last_undegraded":"2021-02-06T22:52:22.221398+0000","last_fullsized":"2021-02-06T22:52:22.221398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220681+0000","last_change":"2021-02-06T22:52:22.219481+0000","last_active":"2021-02-06T22:52:22.220681+0000","last_peered":"2021-02-06T22:52:22.220681+0000","last_clean":"2021-02-06T22:52:22.220681+0000","last_became_active":"2021-02-06T22:52:22.218937+0000","last_became_peered":"2021-02-06T22:52:22.218937+0000","last_unstale":"2021-02-06T22:52:22.220681+0000","last_undegraded":"2021-02-06T22:52:22.220681+0000","last_fullsized":"2021-02-06T22:52:22.220681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221493+0000","last_change":"2021-02-06T22:52:22.220288+0000","last_active":"2021-02-06T22:52:22.221493+0000","last_peered":"2021-02-06T22:52:22.221493+0000","last_clean":"2021-02-06T22:52:22.221493+0000","last_became_active":"2021-02-06T22:52:22.219962+0000","last_became_peered":"2021-02-06T22:52:22.219962+0000","last_unstale":"2021-02-06T22:52:22.221493+0000","last_undegraded":"2021-02-06T22:52:22.221493+0000","last_fullsized":"2021-02-06T22:52:22.221493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221648+0000","last_change":"2021-02-06T22:52:22.218954+0000","last_active":"2021-02-06T22:52:22.221648+0000","last_peered":"2021-02-06T22:52:22.221648+0000","last_clean":"2021-02-06T22:52:22.221648+0000","last_became_active":"2021-02-06T22:52:22.218477+0000","last_became_peered":"2021-02-06T22:52:22.218477+0000","last_unstale":"2021-02-06T22:52:22.221648+0000","last_undegraded":"2021-02-06T22:52:22.221648+0000","last_fullsized":"2021-02-06T22:52:22.221648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640320,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86599999999999999,"15min":0.88100000000000001},"min":{"1min":0.63600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.085,"5min":1.292,"15min":1.292},"last":0.99399999999999999}]},{"osd":1,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.78600000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2250000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0960000000000001,"15min":1.1080000000000001},"min":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2729999999999999,"5min":1.395,"15min":1.395},"last":1.2190000000000001}]},{"osd":2,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.89900000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1359999999999999,"5min":1.204,"15min":1.204},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.95299999999999996,"15min":0.91100000000000003},"min":{"1min":0.77500000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1859999999999999,"5min":1.508,"15min":1.508},"last":1.129}]},{"osd":3,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.58699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91400000000000003,"5min":1.204,"15min":1.204},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84799999999999998,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":11,"seq":47244640320,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.78200000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.288},"last":1.171}]},{"osd":1,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90400000000000003,"15min":0.93500000000000005},"min":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.206,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.84199999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94399999999999995},"min":{"1min":0.65900000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.1679999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.73099999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.02}]},{"osd":3,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75900000000000001,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0429999999999999,"5min":1.177,"15min":1.177},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":0.97499999999999998},"min":{"1min":0.70599999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.073,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1020000000000001,"5min":1.423,"15min":1.423},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1719999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76900000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640321,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.94299999999999995,"15min":0.89800000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0580000000000001,"15min":1.0429999999999999},"min":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0649999999999999,"15min":1.0800000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.96799999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.879,"15min":0.876},"min":{"1min":0.65300000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.123,"5min":1.234,"15min":1.234},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90500000000000003,"15min":0.91700000000000004},"min":{"1min":0.68899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.208,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.071}]},{"osd":4,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.58199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90600000000000003,"5min":1.081,"15min":1.081},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.76100000000000001}]},{"osd":5,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84899999999999998,"15min":0.874},"min":{"1min":0.67300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2929999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89100000000000001,"15min":0.91800000000000004},"min":{"1min":0.753,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.165,"5min":1.399,"15min":1.399},"last":0.79900000000000004}]}]},{"osd":2,"up_from":11,"seq":47244640322,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69999999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.93500000000000005}]},{"osd":1,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.69099999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.407,"15min":1.407},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":1.1799999999999999}]},{"osd":3,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93899999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.206,"5min":1.371,"15min":1.371},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.998,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.84999999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.232}]},{"osd":4,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3520000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0800000000000001,"15min":1.03},"min":{"1min":0.83599999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4099999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.365}]},{"osd":5,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.119,"15min":1.133},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3140000000000001,"5min":1.756,"15min":1.756},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.119,"15min":1.111},"min":{"1min":0.96199999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.504,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.472}]}]},{"osd":0,"up_from":11,"seq":47244640320,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1739999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.83399999999999996}]},{"osd":2,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.88500000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1060000000000001,"5min":1.325,"15min":1.325},"last":0.72799999999999998}]},{"osd":3,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.095},"min":{"1min":0.73499999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1890000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3460000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.002}]},{"osd":4,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.1000000000000001},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":3.073,"15min":3.073},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.052,"15min":1.0960000000000001},"min":{"1min":0.875,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.26,"5min":1.401,"15min":1.401},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0309999999999999,"15min":1.0529999999999999},"min":{"1min":0.80300000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.276,"5min":1.419,"15min":1.419},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.222},"min":{"1min":0.81499999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4610000000000001,"5min":3.149,"15min":3.149},"last":1.218}]}]},{"osd":1,"up_from":11,"seq":47244640320,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.119,"5min":1.3,"15min":1.3},"last":0.80500000000000005}]},{"osd":2,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.157,"15min":1.157},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.83099999999999996},"min":{"1min":0.63900000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.96199999999999997}]},{"osd":3,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.27,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.038,"15min":1.034},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.454,"5min":1.488,"15min":1.488},"last":1.1859999999999999}]},{"osd":4,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.74299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.161,"5min":1.387,"15min":1.387},"last":0.996},{"interface":"front","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.95299999999999996},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.236,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.028}]},{"osd":5,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.028,"15min":1.0169999999999999},"min":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.21,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.115,"5min":1.1499999999999999,"15min":1.1459999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.381,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.351}]}]}]}} 2021-02-06T22:57:31.403 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2021-02-06T22:57:31.525 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.526+0000 7f3639572700 1 Processor -- start 2021-02-06T22:57:31.525 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.526+0000 7f3639572700 1 -- start start 2021-02-06T22:57:31.526 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.526+0000 7f3639572700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634095050 con 0x7f36340999a0 2021-02-06T22:57:31.527 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.526+0000 7f3639572700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634128c00 con 0x7f3634067a30 2021-02-06T22:57:31.527 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.526+0000 7f3639572700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634095280 con 0x7f3634067ec0 2021-02-06T22:57:31.527 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.527+0000 7f36337fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f3634067ec0 0x7f3634130db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33100/0 (socket says 172.21.15.51:33100) 2021-02-06T22:57:31.527 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.527+0000 7f3632ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f36340999a0 0x7f36341284f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60990/0 (socket says 172.21.15.51:60990) 2021-02-06T22:57:31.528 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.527+0000 7f36337fe700 1 -- 172.21.15.51:0/328933299 learned_addr learned my addr 172.21.15.51:0/328933299 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:31.530 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3632ffd700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.51:6789/0 conn(0x7f36340999a0 legacy=0x7f36341284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.531 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f36337fe700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.51:6790/0 conn(0x7f3634067ec0 legacy=0x7f3634130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.531 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073403410 0 0) 0x7f3634095050 con 0x7f36340999a0 2021-02-06T22:57:31.531 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3620003230 con 0x7f36340999a0 2021-02-06T22:57:31.531 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559439913 0 0) 0x7f3634095280 con 0x7f3634067ec0 2021-02-06T22:57:31.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f36327fc700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.106:6789/0 conn(0x7f3634067a30 legacy=0x7f363412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634095050 con 0x7f3634067ec0 2021-02-06T22:57:31.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2329323660 0 0) 0x7f3634128c00 con 0x7f3634067a30 2021-02-06T22:57:31.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634095280 con 0x7f3634067a30 2021-02-06T22:57:31.532 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 752661171 0 0) 0x7f3620003230 con 0x7f36340999a0 2021-02-06T22:57:31.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.51:6790/0 conn(0x7f3634067ec0 legacy=0x7f3634130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.106:6789/0 conn(0x7f3634067a30 legacy=0x7f363412d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.533 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634095520 con 0x7f36340999a0 2021-02-06T22:57:31.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3624001930 con 0x7f36340999a0 2021-02-06T22:57:31.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3624001c40 con 0x7f36340999a0 2021-02-06T22:57:31.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.529+0000 7f3631ffb700 1 -- 172.21.15.51:0/328933299 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3624004690 con 0x7f36340999a0 2021-02-06T22:57:31.534 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.530+0000 7f3639572700 1 -- 172.21.15.51:0/328933299 >> v1:172.21.15.51:6789/0 conn(0x7f36340999a0 legacy=0x7f36341284f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.535 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.530+0000 7f3639572700 1 -- 172.21.15.51:0/328933299 shutdown_connections 2021-02-06T22:57:31.535 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.530+0000 7f3639572700 1 -- 172.21.15.51:0/328933299 >> 172.21.15.51:0/328933299 conn(0x7f3634096860 msgr2=0x7f3634099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:31.535 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.530+0000 7f3639572700 1 -- 172.21.15.51:0/328933299 shutdown_connections 2021-02-06T22:57:31.535 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.530+0000 7f3639572700 1 -- 172.21.15.51:0/328933299 wait complete. 2021-02-06T22:57:31.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 librados: starting msgr at 2021-02-06T22:57:31.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 librados: starting objecter 2021-02-06T22:57:31.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 Processor -- start 2021-02-06T22:57:31.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 -- start start 2021-02-06T22:57:31.536 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 librados: setting wanted keys 2021-02-06T22:57:31.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 librados: calling monclient init 2021-02-06T22:57:31.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363411db70 con 0x7f3634067a30 2021-02-06T22:57:31.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363411de10 con 0x7f36340999a0 2021-02-06T22:57:31.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3639572700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634138810 con 0x7f3634067ec0 2021-02-06T22:57:31.537 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3632ffd700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f3634067a30 0x7f3634137a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:60996/0 (socket says 172.21.15.51:60996) 2021-02-06T22:57:31.538 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.531+0000 7f3632ffd700 1 -- 172.21.15.51:0/1703160031 learned_addr learned my addr 172.21.15.51:0/1703160031 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:31.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f36327fc700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.51:6790/0 conn(0x7f3634067ec0 legacy=0x7f36341212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter ms_handle_connect 0x7f3634067ec0 2021-02-06T22:57:31.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.541 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f3632ffd700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.51:6789/0 conn(0x7f3634067a30 legacy=0x7f3634137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter ms_handle_connect 0x7f3634067a30 2021-02-06T22:57:31.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972924966 0 0) 0x7f3634138810 con 0x7f3634067ec0 2021-02-06T22:57:31.542 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3614004bd0 con 0x7f3634067ec0 2021-02-06T22:57:31.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655207907 0 0) 0x7f363411db70 con 0x7f3634067a30 2021-02-06T22:57:31.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634138810 con 0x7f3634067a30 2021-02-06T22:57:31.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter ms_handle_connect 0x7f36340999a0 2021-02-06T22:57:31.543 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f36337fe700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.106:6789/0 conn(0x7f36340999a0 legacy=0x7f363413fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:31.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:31.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3722255378 0 0) 0x7f3614004bd0 con 0x7f3634067ec0 2021-02-06T22:57:31.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f363411db70 con 0x7f3634067ec0 2021-02-06T22:57:31.544 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3628001be0 con 0x7f3634067ec0 2021-02-06T22:57:31.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2636382263 0 0) 0x7f3634138810 con 0x7f3634067a30 2021-02-06T22:57:31.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3614004bd0 con 0x7f3634067a30 2021-02-06T22:57:31.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f36240018f0 con 0x7f3634067a30 2021-02-06T22:57:31.545 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374569517 0 0) 0x7f363411de10 con 0x7f36340999a0 2021-02-06T22:57:31.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634138810 con 0x7f36340999a0 2021-02-06T22:57:31.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 247764485 0 0) 0x7f363411db70 con 0x7f3634067ec0 2021-02-06T22:57:31.546 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.106:6789/0 conn(0x7f36340999a0 legacy=0x7f363413fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.51:6789/0 conn(0x7f3634067a30 legacy=0x7f3634137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3634138160 con 0x7f3634067ec0 2021-02-06T22:57:31.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36341219f0 con 0x7f3634067ec0 2021-02-06T22:57:31.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f3639572700 10 client.4829.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:31.547 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f363411bc70 con 0x7f3634067ec0 2021-02-06T22:57:31.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f3639572700 1 librados: init done 2021-02-06T22:57:31.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f3628002260 con 0x7f3634067ec0 2021-02-06T22:57:31.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.534+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f3628002570 con 0x7f3634067ec0 2021-02-06T22:57:31.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f3628002750 con 0x7f3634067ec0 2021-02-06T22:57:31.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f3628039390 con 0x7f3634067ec0 2021-02-06T22:57:31.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 10 client.4829.objecter ms_dispatch 0x7f3634001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:31.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 3 client.4829.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:31.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 3 client.4829.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:31.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c004d60 con 0x7f3634067ec0 2021-02-06T22:57:31.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.535+0000 7f361affd700 20 client.4829.objecter dump_active .. 0 homeless 2021-02-06T22:57:31.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.538+0000 7f361affd700 10 client.4829.objecter ms_handle_connect 0x7f36140306d0 2021-02-06T22:57:31.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.539+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f36280122a0 con 0x7f3634067ec0 2021-02-06T22:57:31.723 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.724+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f360c005430 con 0x7f3634067ec0 2021-02-06T22:57:31.723 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.724+0000 7f361affd700 1 -- 172.21.15.51:0/1703160031 <== mon.2 v1:172.21.15.51:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8441 (unknown 4221056075 0 3964562250) 0x7f3628011e90 con 0x7f3634067ec0 2021-02-06T22:57:31.724 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:31.724 INFO:teuthology.orchestra.run.smithi051.stdout:{"epoch":15,"fsid":"4c1ae418-80db-4910-bad7-3f0133db4245","created":"2021-02-06T22:52:10.403964+0000","modified":"2021-02-06T22:52:23.220212+0000","last_up_change":"2021-02-06T22:52:19.190859+0000","last_in_change":"2021-02-06T22:52:19.190859+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-06T22:52:20.713249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f225cc02-dcef-4a50-b04e-8cf67896e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6804","nonce":33691}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6805","nonce":33691}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6807","nonce":33691}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6806","nonce":33691}]},"public_addr":"172.21.15.51:6804/33691","cluster_addr":"172.21.15.51:6805/33691","heartbeat_back_addr":"172.21.15.51:6807/33691","heartbeat_front_addr":"172.21.15.51:6806/33691","state":["exists","up"]},{"osd":1,"uuid":"334a242d-eed9-4d1d-82b0-d0835911d4ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6800","nonce":33692}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6801","nonce":33692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6803","nonce":33692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6802","nonce":33692}]},"public_addr":"172.21.15.51:6800/33692","cluster_addr":"172.21.15.51:6801/33692","heartbeat_back_addr":"172.21.15.51:6803/33692","heartbeat_front_addr":"172.21.15.51:6802/33692","state":["exists","up"]},{"osd":2,"uuid":"2c06d214-feb2-47bd-80ab-66827a74337f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6808","nonce":33693}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6809","nonce":33693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6811","nonce":33693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.51:6810","nonce":33693}]},"public_addr":"172.21.15.51:6808/33693","cluster_addr":"172.21.15.51:6809/33693","heartbeat_back_addr":"172.21.15.51:6811/33693","heartbeat_front_addr":"172.21.15.51:6810/33693","state":["exists","up"]},{"osd":3,"uuid":"cc2b0a47-2bc2-46d5-be82-d55c245ef76d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":33663}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":33663}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":33663}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":33663}]},"public_addr":"172.21.15.106:6804/33663","cluster_addr":"172.21.15.106:6806/33663","heartbeat_back_addr":"172.21.15.106:6810/33663","heartbeat_front_addr":"172.21.15.106:6808/33663","state":["exists","up"]},{"osd":4,"uuid":"a09f85c9-3129-42d5-9060-3d703102de17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":33664}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":33664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":33664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":33664}]},"public_addr":"172.21.15.106:6800/33664","cluster_addr":"172.21.15.106:6801/33664","heartbeat_back_addr":"172.21.15.106:6803/33664","heartbeat_front_addr":"172.21.15.106:6802/33664","state":["exists","up"]},{"osd":5,"uuid":"03ff8953-1929-4b0c-814c-bf7ce41c8729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":33665}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":33665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":33665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":33665}]},"public_addr":"172.21.15.106:6805/33665","cluster_addr":"172.21.15.106:6807/33665","heartbeat_back_addr":"172.21.15.106:6811/33665","heartbeat_front_addr":"172.21.15.106:6809/33665","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.661994+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.658372+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.682516+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.656154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.628693+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-02-06T22:52:17.634124+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-06T22:57:31.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 10 librados: watch_flush enter 2021-02-06T22:57:31.725 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 10 librados: watch_flush exit 2021-02-06T22:57:31.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 20 client.4829.objecter shutdown clearing up homeless session... 2021-02-06T22:57:31.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 10 client.4829.objecter successfully canceled tick 2021-02-06T22:57:31.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.106:6812/33219 conn(0x7f36140306d0 legacy=0x7f3614032b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.726 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 >> v1:172.21.15.51:6790/0 conn(0x7f3634067ec0 legacy=0x7f36341212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:31.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 shutdown_connections 2021-02-06T22:57:31.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 >> 172.21.15.51:0/1703160031 conn(0x7f3634096860 msgr2=0x7f3634097d80 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:31.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 shutdown_connections 2021-02-06T22:57:31.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 -- 172.21.15.51:0/1703160031 wait complete. 2021-02-06T22:57:31.727 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:31.726+0000 7f3639572700 1 librados: shutdown 2021-02-06T22:57:32.737 INFO:tasks.ceph:Scrubbing osd.0 2021-02-06T22:57:32.738 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:32.877 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.878+0000 7f0212cb6700 1 Processor -- start 2021-02-06T22:57:32.878 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.878+0000 7f0212cb6700 1 -- start start 2021-02-06T22:57:32.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0212cb6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0944b0 con 0x7f020c12cef0 2021-02-06T22:57:32.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0212cb6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c090fc0 con 0x7f020c092c50 2021-02-06T22:57:32.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0212cb6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c091260 con 0x7f020c08f600 2021-02-06T22:57:32.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0211253700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f020c12cef0 0x7f020c12f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32776/0 (socket says 172.21.15.51:32776) 2021-02-06T22:57:32.879 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0210a52700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f020c08f600 0x7f020c093da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33114/0 (socket says 172.21.15.51:33114) 2021-02-06T22:57:32.880 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.879+0000 7f0211253700 1 -- 172.21.15.51:0/1415551618 learned_addr learned my addr 172.21.15.51:0/1415551618 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:32.881 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f0211253700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.51:6789/0 conn(0x7f020c12cef0 legacy=0x7f020c12f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f0210a52700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.51:6790/0 conn(0x7f020c08f600 legacy=0x7f020c093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911422038 0 0) 0x7f020c0944b0 con 0x7f020c12cef0 2021-02-06T22:57:32.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01f0003230 con 0x7f020c12cef0 2021-02-06T22:57:32.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291206333 0 0) 0x7f020c091260 con 0x7f020c08f600 2021-02-06T22:57:32.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c0944b0 con 0x7f020c08f600 2021-02-06T22:57:32.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020bfff700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.106:6789/0 conn(0x7f020c092c50 legacy=0x7f020c0930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1199658332 0 0) 0x7f020c0944b0 con 0x7f020c08f600 2021-02-06T22:57:32.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.106:6789/0 conn(0x7f020c092c50 legacy=0x7f020c0930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.51:6789/0 conn(0x7f020c12cef0 legacy=0x7f020c12f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.881+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c091500 con 0x7f020c08f600 2021-02-06T22:57:32.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0200001860 con 0x7f020c08f600 2021-02-06T22:57:32.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0200001b70 con 0x7f020c08f600 2021-02-06T22:57:32.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f020b7fe700 1 -- 172.21.15.51:0/1415551618 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f02000044f0 con 0x7f020c08f600 2021-02-06T22:57:32.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f0212cb6700 1 -- 172.21.15.51:0/1415551618 >> v1:172.21.15.51:6790/0 conn(0x7f020c08f600 legacy=0x7f020c093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f0212cb6700 1 -- 172.21.15.51:0/1415551618 shutdown_connections 2021-02-06T22:57:32.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f0212cb6700 1 -- 172.21.15.51:0/1415551618 >> 172.21.15.51:0/1415551618 conn(0x7f020c099460 msgr2=0x7f020c099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:32.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f0212cb6700 1 -- 172.21.15.51:0/1415551618 shutdown_connections 2021-02-06T22:57:32.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.882+0000 7f0212cb6700 1 -- 172.21.15.51:0/1415551618 wait complete. 2021-02-06T22:57:32.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 librados: starting msgr at 2021-02-06T22:57:32.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 librados: starting objecter 2021-02-06T22:57:32.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 Processor -- start 2021-02-06T22:57:32.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 -- start start 2021-02-06T22:57:32.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 librados: setting wanted keys 2021-02-06T22:57:32.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.883+0000 7f0212cb6700 1 librados: calling monclient init 2021-02-06T22:57:32.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.884+0000 7f0212cb6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c110e40 con 0x7f020c08f600 2021-02-06T22:57:32.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.884+0000 7f0212cb6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c1110e0 con 0x7f020c092c50 2021-02-06T22:57:32.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.884+0000 7f0212cb6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c111380 con 0x7f020c12cef0 2021-02-06T22:57:32.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.884+0000 7f0210a52700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f020c08f600 0x7f020c12ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32778/0 (socket says 172.21.15.51:32778) 2021-02-06T22:57:32.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.884+0000 7f0210a52700 1 -- 172.21.15.51:0/3917259467 learned_addr learned my addr 172.21.15.51:0/3917259467 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:32.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0210a52700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.51:6789/0 conn(0x7f020c08f600 legacy=0x7f020c12ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter ms_handle_connect 0x7f020c08f600 2021-02-06T22:57:32.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:32.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0211253700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.51:6790/0 conn(0x7f020c12cef0 legacy=0x7f020c13f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter ms_handle_connect 0x7f020c12cef0 2021-02-06T22:57:32.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:32.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter ms_handle_connect 0x7f020c092c50 2021-02-06T22:57:32.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:32.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f020bfff700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.106:6789/0 conn(0x7f020c092c50 legacy=0x7f020c13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:32.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4038980974 0 0) 0x7f020c110e40 con 0x7f020c08f600 2021-02-06T22:57:32.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec004bd0 con 0x7f020c08f600 2021-02-06T22:57:32.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270451285 0 0) 0x7f020c111380 con 0x7f020c12cef0 2021-02-06T22:57:32.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f020c110e40 con 0x7f020c12cef0 2021-02-06T22:57:32.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2931849492 0 0) 0x7f020c110e40 con 0x7f020c12cef0 2021-02-06T22:57:32.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f020c111380 con 0x7f020c12cef0 2021-02-06T22:57:32.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0204001d30 con 0x7f020c12cef0 2021-02-06T22:57:32.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 509222814 0 0) 0x7f01ec004bd0 con 0x7f020c08f600 2021-02-06T22:57:32.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f020c110e40 con 0x7f020c08f600 2021-02-06T22:57:32.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421743038 0 0) 0x7f020c1110e0 con 0x7f020c092c50 2021-02-06T22:57:32.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec004bd0 con 0x7f020c092c50 2021-02-06T22:57:32.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.886+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f02000044f0 con 0x7f020c08f600 2021-02-06T22:57:32.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 124687077 0 0) 0x7f020c111380 con 0x7f020c12cef0 2021-02-06T22:57:32.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.106:6789/0 conn(0x7f020c092c50 legacy=0x7f020c13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.51:6789/0 conn(0x7f020c08f600 legacy=0x7f020c12ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c067750 con 0x7f020c12cef0 2021-02-06T22:57:32.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c10feb0 con 0x7f020c12cef0 2021-02-06T22:57:32.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 10 client.4835.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:32.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c12c300 con 0x7f020c12cef0 2021-02-06T22:57:32.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 1 librados: init done 2021-02-06T22:57:32.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0204004c20 con 0x7f020c12cef0 2021-02-06T22:57:32.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0204004f30 con 0x7f020c12cef0 2021-02-06T22:57:32.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0204005090 con 0x7f020c12cef0 2021-02-06T22:57:32.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 10 client.4835.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:32.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 15 client.4835.objecter _session_command_op_assign -1 1 2021-02-06T22:57:32.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 20 client.4835.objecter _get_session osd=-1 returning homeless 2021-02-06T22:57:32.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 10 client.4835.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:32.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.887+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01e4002870 con 0x7f020c12cef0 2021-02-06T22:57:32.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0204039780 con 0x7f020c12cef0 2021-02-06T22:57:32.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 10 client.4835.objecter ms_dispatch 0x7f020c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:32.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 3 client.4835.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:32.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 3 client.4835.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:32.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 10 client.4835.objecter checking command 1 2021-02-06T22:57:32.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter _get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 15 client.4835.objecter _session_command_op_remove -1 1 2021-02-06T22:57:32.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter _get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 15 client.4835.objecter _session_command_op_assign 0 1 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 4 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 10 client.4835.objecter _send_command 1 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6804/33691 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01ec03aea0 con 0x7f01ec037210 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 20 client.4835.objecter dump_active .. 0 homeless 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.888+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f02040123e0 con 0x7f020c12cef0 2021-02-06T22:57:32.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.890+0000 7f0208ff9700 10 client.4835.objecter ms_handle_connect 0x7f01ec0307d0 2021-02-06T22:57:32.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.892+0000 7f0208ff9700 10 client.4835.objecter ms_handle_connect 0x7f01ec037210 2021-02-06T22:57:32.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.893+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== osd.0 v1:172.21.15.51:6804/33691 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f01ec03aea0 con 0x7f01ec037210 2021-02-06T22:57:32.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.893+0000 7f0208ff9700 10 client.4835.objecter ms_dispatch 0x7f020c001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:32.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.893+0000 7f0208ff9700 10 client.4835.objecter _finish_command 1 = system:0 2021-02-06T22:57:32.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.893+0000 7f0208ff9700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 4 2021-02-06T22:57:32.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.893+0000 7f0208ff9700 15 client.4835.objecter _session_command_op_remove 0 1 2021-02-06T22:57:32.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 client.4835.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:32.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 15 client.4835.objecter _session_command_op_assign -1 2 2021-02-06T22:57:32.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter _get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter _get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 15 client.4835.objecter _session_command_op_remove -1 2 2021-02-06T22:57:32.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter get_session s=0x7f01ec036b60 osd=0 3 2021-02-06T22:57:32.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 15 client.4835.objecter _session_command_op_assign 0 2 2021-02-06T22:57:32.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 4 2021-02-06T22:57:32.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 client.4835.objecter _send_command 2 2021-02-06T22:57:32.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 --> v1:172.21.15.51:6804/33691 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f01e4001160 con 0x7f01ec037210 2021-02-06T22:57:32.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0208ff9700 1 -- 172.21.15.51:0/3917259467 <== osd.0 v1:172.21.15.51:6804/33691 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f01e4001160 con 0x7f01ec037210 2021-02-06T22:57:32.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0208ff9700 10 client.4835.objecter ms_dispatch 0x7f020c001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:32.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0208ff9700 10 client.4835.objecter _finish_command 2 = system:0 2021-02-06T22:57:32.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0208ff9700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 4 2021-02-06T22:57:32.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0208ff9700 15 client.4835.objecter _session_command_op_remove 0 2 2021-02-06T22:57:32.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 librados: watch_flush enter 2021-02-06T22:57:32.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 librados: watch_flush exit 2021-02-06T22:57:32.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 client.4835.objecter close_session for osd.0 2021-02-06T22:57:32.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.51:6804/33691 conn(0x7f01ec037210 legacy=0x7f01ec039630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter put_session s=0x7f01ec036b60 osd=0 1 2021-02-06T22:57:32.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 20 client.4835.objecter shutdown clearing up homeless session... 2021-02-06T22:57:32.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 10 client.4835.objecter successfully canceled tick 2021-02-06T22:57:32.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.106:6812/33219 conn(0x7f01ec0307d0 legacy=0x7f01ec032c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 >> v1:172.21.15.51:6790/0 conn(0x7f020c12cef0 legacy=0x7f020c13f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:32.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0211253700 1 -- 172.21.15.51:0/3917259467 reap_dead start 2021-02-06T22:57:32.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 shutdown_connections 2021-02-06T22:57:32.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 >> 172.21.15.51:0/3917259467 conn(0x7f020c099460 msgr2=0x7f020c095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:32.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.909+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 shutdown_connections 2021-02-06T22:57:32.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.910+0000 7f0212cb6700 1 -- 172.21.15.51:0/3917259467 wait complete. 2021-02-06T22:57:32.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:32.910+0000 7f0212cb6700 1 librados: shutdown 2021-02-06T22:57:32.916 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:32.916 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:32.916 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:32.920 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2021-02-06T22:57:33.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.044+0000 7f708ee1a700 1 Processor -- start 2021-02-06T22:57:33.043 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.044+0000 7f708ee1a700 1 -- start start 2021-02-06T22:57:33.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.044+0000 7f708ee1a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880915d0 con 0x7f70880928d0 2021-02-06T22:57:33.044 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.044+0000 7f708ee1a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088091ac0 con 0x7f70880629e0 2021-02-06T22:57:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.044+0000 7f708ee1a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088091d60 con 0x7f70880999a0 2021-02-06T22:57:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.045+0000 7f708d3b7700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f70880928d0 0x7f708812fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32790/0 (socket says 172.21.15.51:32790) 2021-02-06T22:57:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.045+0000 7f708cbb6700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f70880999a0 0x7f70880907b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33128/0 (socket says 172.21.15.51:33128) 2021-02-06T22:57:33.045 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.045+0000 7f708d3b7700 1 -- 172.21.15.51:0/3787257618 learned_addr learned my addr 172.21.15.51:0/3787257618 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f708cbb6700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.51:6790/0 conn(0x7f70880999a0 legacy=0x7f70880907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f708d3b7700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.51:6789/0 conn(0x7f70880928d0 legacy=0x7f708812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488864671 0 0) 0x7f7088091d60 con 0x7f70880999a0 2021-02-06T22:57:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f706c003230 con 0x7f70880999a0 2021-02-06T22:57:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f7087fff700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.106:6789/0 conn(0x7f70880629e0 legacy=0x7f7088090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204536539 0 0) 0x7f70880915d0 con 0x7f70880928d0 2021-02-06T22:57:33.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088091d60 con 0x7f70880928d0 2021-02-06T22:57:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089485058 0 0) 0x7f7088091ac0 con 0x7f70880629e0 2021-02-06T22:57:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70880915d0 con 0x7f70880629e0 2021-02-06T22:57:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2568929902 0 0) 0x7f706c003230 con 0x7f70880999a0 2021-02-06T22:57:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.106:6789/0 conn(0x7f70880629e0 legacy=0x7f7088090ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.51:6789/0 conn(0x7f70880928d0 legacy=0x7f708812fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088092000 con 0x7f70880999a0 2021-02-06T22:57:33.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f707c001930 con 0x7f70880999a0 2021-02-06T22:57:33.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f707c001c40 con 0x7f70880999a0 2021-02-06T22:57:33.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.047+0000 7f70877fe700 1 -- 172.21.15.51:0/3787257618 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f707c004690 con 0x7f70880999a0 2021-02-06T22:57:33.050 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.048+0000 7f708ee1a700 1 -- 172.21.15.51:0/3787257618 >> v1:172.21.15.51:6790/0 conn(0x7f70880999a0 legacy=0x7f70880907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.048+0000 7f708ee1a700 1 -- 172.21.15.51:0/3787257618 shutdown_connections 2021-02-06T22:57:33.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.048+0000 7f708ee1a700 1 -- 172.21.15.51:0/3787257618 >> 172.21.15.51:0/3787257618 conn(0x7f7088096860 msgr2=0x7f7088099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.048+0000 7f708ee1a700 1 -- 172.21.15.51:0/3787257618 shutdown_connections 2021-02-06T22:57:33.051 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.048+0000 7f708ee1a700 1 -- 172.21.15.51:0/3787257618 wait complete. 2021-02-06T22:57:33.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 librados: starting msgr at 2021-02-06T22:57:33.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 librados: starting objecter 2021-02-06T22:57:33.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 Processor -- start 2021-02-06T22:57:33.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 -- start start 2021-02-06T22:57:33.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 librados: setting wanted keys 2021-02-06T22:57:33.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 librados: calling monclient init 2021-02-06T22:57:33.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088095160 con 0x7f70880999a0 2021-02-06T22:57:33.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70881161d0 con 0x7f70880629e0 2021-02-06T22:57:33.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f708ee1a700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7088067550 con 0x7f70880928d0 2021-02-06T22:57:33.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f7087fff700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f70880928d0 0x7f708812f2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33136/0 (socket says 172.21.15.51:33136) 2021-02-06T22:57:33.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.049+0000 7f7087fff700 1 -- 172.21.15.51:0/3424804608 learned_addr learned my addr 172.21.15.51:0/3424804608 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7087fff700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.51:6790/0 conn(0x7f70880928d0 legacy=0x7f708812f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708d3b7700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.51:6789/0 conn(0x7f70880999a0 legacy=0x7f708813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter ms_handle_connect 0x7f70880928d0 2021-02-06T22:57:33.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter ms_handle_connect 0x7f70880999a0 2021-02-06T22:57:33.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100492979 0 0) 0x7f7088067550 con 0x7f70880928d0 2021-02-06T22:57:33.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7068004bd0 con 0x7f70880928d0 2021-02-06T22:57:33.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708cbb6700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.106:6789/0 conn(0x7f70880629e0 legacy=0x7f7088135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter ms_handle_connect 0x7f70880629e0 2021-02-06T22:57:33.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939772341 0 0) 0x7f7088095160 con 0x7f70880999a0 2021-02-06T22:57:33.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088067550 con 0x7f70880999a0 2021-02-06T22:57:33.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 985124854 0 0) 0x7f7088067550 con 0x7f70880999a0 2021-02-06T22:57:33.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7088095160 con 0x7f70880999a0 2021-02-06T22:57:33.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7080001d10 con 0x7f70880999a0 2021-02-06T22:57:33.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024601857 0 0) 0x7f70881161d0 con 0x7f70880629e0 2021-02-06T22:57:33.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7088067550 con 0x7f70880629e0 2021-02-06T22:57:33.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 482757153 0 0) 0x7f7068004bd0 con 0x7f70880928d0 2021-02-06T22:57:33.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f70881161d0 con 0x7f70880928d0 2021-02-06T22:57:33.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7074001c60 con 0x7f70880928d0 2021-02-06T22:57:33.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2973000801 0 0) 0x7f7088095160 con 0x7f70880999a0 2021-02-06T22:57:33.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.51:6790/0 conn(0x7f70880928d0 legacy=0x7f708812f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.106:6789/0 conn(0x7f70880629e0 legacy=0x7f7088135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708812f9d0 con 0x7f70880999a0 2021-02-06T22:57:33.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70881157d0 con 0x7f70880999a0 2021-02-06T22:57:33.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708ee1a700 10 client.4869.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:33.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088114190 con 0x7f70880999a0 2021-02-06T22:57:33.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f708ee1a700 1 librados: init done 2021-02-06T22:57:33.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7080004c20 con 0x7f70880999a0 2021-02-06T22:57:33.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.052+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7080004f30 con 0x7f70880999a0 2021-02-06T22:57:33.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f7080005110 con 0x7f70880999a0 2021-02-06T22:57:33.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f7080039870 con 0x7f70880999a0 2021-02-06T22:57:33.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 10 client.4869.objecter ms_dispatch 0x7f7088001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:33.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 3 client.4869.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:33.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 3 client.4869.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:33.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f7084ff9700 20 client.4869.objecter dump_active .. 0 homeless 2021-02-06T22:57:33.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.053+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7060004d60 con 0x7f70880999a0 2021-02-06T22:57:33.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.056+0000 7f7084ff9700 10 client.4869.objecter ms_handle_connect 0x7f70680307a0 2021-02-06T22:57:33.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.057+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f7080012760 con 0x7f70880999a0 2021-02-06T22:57:33.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.241+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7060000b50 con 0x7f70680307a0 2021-02-06T22:57:33.241 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.242+0000 7f7084ff9700 1 -- 172.21.15.51:0/3424804608 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f7060000b50 con 0x7f70680307a0 2021-02-06T22:57:33.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 10 librados: watch_flush enter 2021-02-06T22:57:33.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 10 librados: watch_flush exit 2021-02-06T22:57:33.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 20 client.4869.objecter shutdown clearing up homeless session... 2021-02-06T22:57:33.243 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 10 client.4869.objecter successfully canceled tick 2021-02-06T22:57:33.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.106:6812/33219 conn(0x7f70680307a0 legacy=0x7f7068032c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 >> v1:172.21.15.51:6789/0 conn(0x7f70880999a0 legacy=0x7f708813d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 shutdown_connections 2021-02-06T22:57:33.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.243+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 >> 172.21.15.51:0/3424804608 conn(0x7f7088096860 msgr2=0x7f7088064e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.244 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.244+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 shutdown_connections 2021-02-06T22:57:33.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.244+0000 7f708ee1a700 1 -- 172.21.15.51:0/3424804608 wait complete. 2021-02-06T22:57:33.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.244+0000 7f708ee1a700 1 librados: shutdown 2021-02-06T22:57:33.245 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 0 to deep-scrub 2021-02-06T22:57:33.255 INFO:tasks.ceph:Scrubbing osd.1 2021-02-06T22:57:33.256 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:33.382 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.383+0000 7fa0c7ea6700 1 Processor -- start 2021-02-06T22:57:33.383 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.383+0000 7fa0c7ea6700 1 -- start start 2021-02-06T22:57:33.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c00944b0 con 0x7fa0c008f600 2021-02-06T22:57:33.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0090fc0 con 0x7fa0c0092c50 2021-02-06T22:57:33.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0091260 con 0x7fa0c012cef0 2021-02-06T22:57:33.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c5c42700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa0c008f600 0x7fa0c0093da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32800/0 (socket says 172.21.15.51:32800) 2021-02-06T22:57:33.384 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c5c42700 1 -- 172.21.15.51:0/1980705810 learned_addr learned my addr 172.21.15.51:0/1980705810 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.385 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.384+0000 7fa0c6443700 1 --1- 172.21.15.51:0/1980705810 >> v1:172.21.15.51:6790/0 conn(0x7fa0c012cef0 0x7fa0c012f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33144/0 (socket says 172.21.15.51:33144) 2021-02-06T22:57:33.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.386+0000 7fa0c6443700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.51:6790/0 conn(0x7fa0c012cef0 legacy=0x7fa0c012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.386+0000 7fa0c5c42700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.51:6789/0 conn(0x7fa0c008f600 legacy=0x7fa0c0093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c5441700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.106:6789/0 conn(0x7fa0c0092c50 legacy=0x7fa0c00930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139924887 0 0) 0x7fa0c0091260 con 0x7fa0c012cef0 2021-02-06T22:57:33.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a8003230 con 0x7fa0c012cef0 2021-02-06T22:57:33.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147531696 0 0) 0x7fa0c00944b0 con 0x7fa0c008f600 2021-02-06T22:57:33.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c0091260 con 0x7fa0c008f600 2021-02-06T22:57:33.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361452457 0 0) 0x7fa0c0090fc0 con 0x7fa0c0092c50 2021-02-06T22:57:33.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c00944b0 con 0x7fa0c0092c50 2021-02-06T22:57:33.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4234492550 0 0) 0x7fa0c0091260 con 0x7fa0c008f600 2021-02-06T22:57:33.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.51:6790/0 conn(0x7fa0c012cef0 legacy=0x7fa0c012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.106:6789/0 conn(0x7fa0c0092c50 legacy=0x7fa0c00930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0091500 con 0x7fa0c008f600 2021-02-06T22:57:33.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0bc001930 con 0x7fa0c008f600 2021-02-06T22:57:33.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa0bc001c40 con 0x7fa0c008f600 2021-02-06T22:57:33.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c4c40700 1 -- 172.21.15.51:0/1980705810 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0bc004750 con 0x7fa0c008f600 2021-02-06T22:57:33.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.387+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/1980705810 >> v1:172.21.15.51:6789/0 conn(0x7fa0c008f600 legacy=0x7fa0c0093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.391 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/1980705810 shutdown_connections 2021-02-06T22:57:33.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/1980705810 >> 172.21.15.51:0/1980705810 conn(0x7fa0c0099460 msgr2=0x7fa0c0099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/1980705810 shutdown_connections 2021-02-06T22:57:33.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/1980705810 wait complete. 2021-02-06T22:57:33.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 librados: starting msgr at 2021-02-06T22:57:33.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 librados: starting objecter 2021-02-06T22:57:33.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 Processor -- start 2021-02-06T22:57:33.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 -- start start 2021-02-06T22:57:33.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 librados: setting wanted keys 2021-02-06T22:57:33.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.388+0000 7fa0c7ea6700 1 librados: calling monclient init 2021-02-06T22:57:33.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.389+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0097ae0 con 0x7fa0c008f600 2021-02-06T22:57:33.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.389+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c013aa40 con 0x7fa0c012cef0 2021-02-06T22:57:33.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.389+0000 7fa0c7ea6700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0c0128780 con 0x7fa0c0092c50 2021-02-06T22:57:33.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.389+0000 7fa0c5441700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fa0c0092c50 0x7fa0c012bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33150/0 (socket says 172.21.15.51:33150) 2021-02-06T22:57:33.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.389+0000 7fa0c5441700 1 -- 172.21.15.51:0/3112534914 learned_addr learned my addr 172.21.15.51:0/3112534914 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0c5441700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.51:6790/0 conn(0x7fa0c0092c50 legacy=0x7fa0c012bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter ms_handle_connect 0x7fa0c0092c50 2021-02-06T22:57:33.398 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0c5c42700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.51:6789/0 conn(0x7fa0c008f600 legacy=0x7fa0c0139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter ms_handle_connect 0x7fa0c008f600 2021-02-06T22:57:33.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter ms_handle_connect 0x7fa0c012cef0 2021-02-06T22:57:33.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0adffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.391+0000 7fa0c6443700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.106:6789/0 conn(0x7fa0c012cef0 legacy=0x7fa0c0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931872229 0 0) 0x7fa0c013aa40 con 0x7fa0c012cef0 2021-02-06T22:57:33.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a0004bd0 con 0x7fa0c012cef0 2021-02-06T22:57:33.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775670126 0 0) 0x7fa0c0128780 con 0x7fa0c0092c50 2021-02-06T22:57:33.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c013aa40 con 0x7fa0c0092c50 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702051545 0 0) 0x7fa0c0097ae0 con 0x7fa0c008f600 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c0128780 con 0x7fa0c008f600 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1954553034 0 0) 0x7fa0c013aa40 con 0x7fa0c0092c50 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0c0097ae0 con 0x7fa0c0092c50 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0b0001cb0 con 0x7fa0c0092c50 2021-02-06T22:57:33.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2005257664 0 0) 0x7fa0a0004bd0 con 0x7fa0c012cef0 2021-02-06T22:57:33.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0c013aa40 con 0x7fa0c012cef0 2021-02-06T22:57:33.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0b8001fe0 con 0x7fa0c012cef0 2021-02-06T22:57:33.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2170210961 0 0) 0x7fa0c0128780 con 0x7fa0c008f600 2021-02-06T22:57:33.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0a0004bd0 con 0x7fa0c008f600 2021-02-06T22:57:33.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0bc004690 con 0x7fa0c008f600 2021-02-06T22:57:33.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2503801248 0 0) 0x7fa0c0097ae0 con 0x7fa0c0092c50 2021-02-06T22:57:33.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.106:6789/0 conn(0x7fa0c012cef0 legacy=0x7fa0c0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.51:6789/0 conn(0x7fa0c008f600 legacy=0x7fa0c0139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0128a20 con 0x7fa0c0092c50 2021-02-06T22:57:33.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c01326c0 con 0x7fa0c0092c50 2021-02-06T22:57:33.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa0b00023a0 con 0x7fa0c0092c50 2021-02-06T22:57:33.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa0b00026b0 con 0x7fa0c0092c50 2021-02-06T22:57:33.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0c7ea6700 10 client.4847.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:33.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0c012c600 con 0x7fa0c0092c50 2021-02-06T22:57:33.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.392+0000 7fa0c7ea6700 1 librados: init done 2021-02-06T22:57:33.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fa0b0002810 con 0x7fa0c0092c50 2021-02-06T22:57:33.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fa0b0039540 con 0x7fa0c0092c50 2021-02-06T22:57:33.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 10 client.4847.objecter ms_dispatch 0x7fa0c0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:33.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 3 client.4847.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:33.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 3 client.4847.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:33.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0adffb700 20 client.4847.objecter dump_active .. 0 homeless 2021-02-06T22:57:33.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 10 client.4847.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:33.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_assign -1 1 2021-02-06T22:57:33.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 20 client.4847.objecter _get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 20 client.4847.objecter _get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_remove -1 1 2021-02-06T22:57:33.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 20 client.4847.objecter get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_assign 1 1 2021-02-06T22:57:33.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 4 2021-02-06T22:57:33.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 10 client.4847.objecter _send_command 1 2021-02-06T22:57:33.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.393+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6800/33692 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0c0066e70 con 0x7fa0c0066380 2021-02-06T22:57:33.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.395+0000 7fa0adffb700 10 client.4847.objecter ms_handle_connect 0x7fa0a0030910 2021-02-06T22:57:33.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 10 client.4847.objecter ms_handle_connect 0x7fa0c0066380 2021-02-06T22:57:33.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== osd.1 v1:172.21.15.51:6800/33692 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7fa0b8007b10 con 0x7fa0c0066380 2021-02-06T22:57:33.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 10 client.4847.objecter ms_dispatch 0x7fa0c0001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:33.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 10 client.4847.objecter _finish_command 1 = system:0 2021-02-06T22:57:33.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 4 2021-02-06T22:57:33.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.398+0000 7fa0adffb700 15 client.4847.objecter _session_command_op_remove 1 1 2021-02-06T22:57:33.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 client.4847.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:33.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_assign -1 2 2021-02-06T22:57:33.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter _get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter _get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_remove -1 2 2021-02-06T22:57:33.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter get_session s=0x7fa0c012c8b0 osd=1 3 2021-02-06T22:57:33.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 15 client.4847.objecter _session_command_op_assign 1 2 2021-02-06T22:57:33.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 4 2021-02-06T22:57:33.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 client.4847.objecter _send_command 2 2021-02-06T22:57:33.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 --> v1:172.21.15.51:6800/33692 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0c00581b0 con 0x7fa0c0066380 2021-02-06T22:57:33.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0adffb700 1 -- 172.21.15.51:0/3112534914 <== osd.1 v1:172.21.15.51:6800/33692 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7fa0c00581b0 con 0x7fa0c0066380 2021-02-06T22:57:33.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0adffb700 10 client.4847.objecter ms_dispatch 0x7fa0c0001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:33.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0adffb700 10 client.4847.objecter _finish_command 2 = system:0 2021-02-06T22:57:33.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0adffb700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 4 2021-02-06T22:57:33.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0adffb700 15 client.4847.objecter _session_command_op_remove 1 2 2021-02-06T22:57:33.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 librados: watch_flush enter 2021-02-06T22:57:33.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 librados: watch_flush exit 2021-02-06T22:57:33.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 client.4847.objecter close_session for osd.1 2021-02-06T22:57:33.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.51:6800/33692 conn(0x7fa0c0066380 legacy=0x7fa0c0066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter put_session s=0x7fa0c012c8b0 osd=1 1 2021-02-06T22:57:33.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 20 client.4847.objecter shutdown clearing up homeless session... 2021-02-06T22:57:33.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.414+0000 7fa0c7ea6700 10 client.4847.objecter successfully canceled tick 2021-02-06T22:57:33.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.106:6812/33219 conn(0x7fa0a0030910 legacy=0x7fa0a0032dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 >> v1:172.21.15.51:6790/0 conn(0x7fa0c0092c50 legacy=0x7fa0c012bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c6443700 1 -- 172.21.15.51:0/3112534914 reap_dead start 2021-02-06T22:57:33.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 shutdown_connections 2021-02-06T22:57:33.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 >> 172.21.15.51:0/3112534914 conn(0x7fa0c0099460 msgr2=0x7fa0c0095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 shutdown_connections 2021-02-06T22:57:33.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 -- 172.21.15.51:0/3112534914 wait complete. 2021-02-06T22:57:33.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.415+0000 7fa0c7ea6700 1 librados: shutdown 2021-02-06T22:57:33.421 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:33.421 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:33.421 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:33.425 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2021-02-06T22:57:33.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.549+0000 7f71686e5700 1 Processor -- start 2021-02-06T22:57:33.548 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.549+0000 7f71686e5700 1 -- start start 2021-02-06T22:57:33.549 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f71686e5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7160095440 con 0x7f7160092bf0 2021-02-06T22:57:33.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f71686e5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600907b0 con 0x7f716008fa70 2021-02-06T22:57:33.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f71686e5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7160091010 con 0x7f716012ce00 2021-02-06T22:57:33.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f7165c80700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f7160092bf0 0x7f71600930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32818/0 (socket says 172.21.15.51:32818) 2021-02-06T22:57:33.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f7165c80700 1 -- 172.21.15.51:0/651634334 learned_addr learned my addr 172.21.15.51:0/651634334 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.550 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.550+0000 7f7166c82700 1 --1- 172.21.15.51:0/651634334 >> v1:172.21.15.51:6790/0 conn(0x7f716012ce00 0x7f716012f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33162/0 (socket says 172.21.15.51:33162) 2021-02-06T22:57:33.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f7165c80700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.51:6789/0 conn(0x7f7160092bf0 legacy=0x7f71600930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f7166c82700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.51:6790/0 conn(0x7f716012ce00 legacy=0x7f716012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.553 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396282190 0 0) 0x7f7160095440 con 0x7f7160092bf0 2021-02-06T22:57:33.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7148003230 con 0x7f7160092bf0 2021-02-06T22:57:33.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757902469 0 0) 0x7f7160091010 con 0x7f716012ce00 2021-02-06T22:57:33.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7160095440 con 0x7f716012ce00 2021-02-06T22:57:33.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f7166481700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.106:6789/0 conn(0x7f716008fa70 legacy=0x7f71600921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1395023079 0 0) 0x7f7148003230 con 0x7f7160092bf0 2021-02-06T22:57:33.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.51:6790/0 conn(0x7f716012ce00 legacy=0x7f716012f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.106:6789/0 conn(0x7f716008fa70 legacy=0x7f71600921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600912b0 con 0x7f7160092bf0 2021-02-06T22:57:33.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7150001930 con 0x7f7160092bf0 2021-02-06T22:57:33.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.552+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7158001cb0 con 0x7f716012ce00 2021-02-06T22:57:33.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7150001c40 con 0x7f7160092bf0 2021-02-06T22:57:33.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f716547f700 1 -- 172.21.15.51:0/651634334 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f7150004750 con 0x7f7160092bf0 2021-02-06T22:57:33.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f71686e5700 1 -- 172.21.15.51:0/651634334 >> v1:172.21.15.51:6789/0 conn(0x7f7160092bf0 legacy=0x7f71600930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f71686e5700 1 -- 172.21.15.51:0/651634334 shutdown_connections 2021-02-06T22:57:33.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f71686e5700 1 -- 172.21.15.51:0/651634334 >> 172.21.15.51:0/651634334 conn(0x7f7160096860 msgr2=0x7f7160099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f71686e5700 1 -- 172.21.15.51:0/651634334 shutdown_connections 2021-02-06T22:57:33.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.553+0000 7f71686e5700 1 -- 172.21.15.51:0/651634334 wait complete. 2021-02-06T22:57:33.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 librados: starting msgr at 2021-02-06T22:57:33.557 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 librados: starting objecter 2021-02-06T22:57:33.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 Processor -- start 2021-02-06T22:57:33.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 -- start start 2021-02-06T22:57:33.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 librados: setting wanted keys 2021-02-06T22:57:33.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 librados: calling monclient init 2021-02-06T22:57:33.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7160111d60 con 0x7f7160092bf0 2021-02-06T22:57:33.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7160112000 con 0x7f716012ce00 2021-02-06T22:57:33.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f71686e5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71601122a0 con 0x7f716008fa70 2021-02-06T22:57:33.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f7166481700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f716008fa70 0x7f716012b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33164/0 (socket says 172.21.15.51:33164) 2021-02-06T22:57:33.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.554+0000 7f7166481700 1 -- 172.21.15.51:0/2972558144 learned_addr learned my addr 172.21.15.51:0/2972558144 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f7165c80700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.51:6789/0 conn(0x7f7160092bf0 legacy=0x7f716013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f7166481700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.51:6790/0 conn(0x7f716008fa70 legacy=0x7f716012b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter ms_handle_connect 0x7f7160092bf0 2021-02-06T22:57:33.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter ms_handle_connect 0x7f716008fa70 2021-02-06T22:57:33.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116467268 0 0) 0x7f71601122a0 con 0x7f716008fa70 2021-02-06T22:57:33.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7140004bd0 con 0x7f716008fa70 2021-02-06T22:57:33.564 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018263799 0 0) 0x7f7160111d60 con 0x7f7160092bf0 2021-02-06T22:57:33.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71601122a0 con 0x7f7160092bf0 2021-02-06T22:57:33.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f7166c82700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.106:6789/0 conn(0x7f716012ce00 legacy=0x7f71601400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter ms_handle_connect 0x7f716012ce00 2021-02-06T22:57:33.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.565 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4138712133 0 0) 0x7f7140004bd0 con 0x7f716008fa70 2021-02-06T22:57:33.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7160111d60 con 0x7f716008fa70 2021-02-06T22:57:33.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f715c001bc0 con 0x7f716008fa70 2021-02-06T22:57:33.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1721810673 0 0) 0x7f71601122a0 con 0x7f7160092bf0 2021-02-06T22:57:33.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7140004bd0 con 0x7f7160092bf0 2021-02-06T22:57:33.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f71500018f0 con 0x7f7160092bf0 2021-02-06T22:57:33.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254823196 0 0) 0x7f7160112000 con 0x7f716012ce00 2021-02-06T22:57:33.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71601122a0 con 0x7f716012ce00 2021-02-06T22:57:33.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1933958703 0 0) 0x7f7160111d60 con 0x7f716008fa70 2021-02-06T22:57:33.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.106:6789/0 conn(0x7f716012ce00 legacy=0x7f71601400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.51:6789/0 conn(0x7f7160092bf0 legacy=0x7f716013c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71601329e0 con 0x7f716008fa70 2021-02-06T22:57:33.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716012aeb0 con 0x7f716008fa70 2021-02-06T22:57:33.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f71686e5700 10 client.4853.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:33.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f7160110dd0 con 0x7f716008fa70 2021-02-06T22:57:33.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f71686e5700 1 librados: init done 2021-02-06T22:57:33.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f715c002270 con 0x7f716008fa70 2021-02-06T22:57:33.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.557+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f715c002580 con 0x7f716008fa70 2021-02-06T22:57:33.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f715c0026e0 con 0x7f716008fa70 2021-02-06T22:57:33.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f715c039480 con 0x7f716008fa70 2021-02-06T22:57:33.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 10 client.4853.objecter ms_dispatch 0x7f7160001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:33.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 3 client.4853.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:33.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 3 client.4853.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:33.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144004d60 con 0x7f716008fa70 2021-02-06T22:57:33.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.558+0000 7f714e7fc700 20 client.4853.objecter dump_active .. 0 homeless 2021-02-06T22:57:33.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.561+0000 7f714e7fc700 10 client.4853.objecter ms_handle_connect 0x7f7140030740 2021-02-06T22:57:33.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.562+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f715c012390 con 0x7f716008fa70 2021-02-06T22:57:33.742 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.743+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7144000b50 con 0x7f7140030740 2021-02-06T22:57:33.743 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.744+0000 7f714e7fc700 1 -- 172.21.15.51:0/2972558144 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f7144000b50 con 0x7f7140030740 2021-02-06T22:57:33.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 10 librados: watch_flush enter 2021-02-06T22:57:33.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 10 librados: watch_flush exit 2021-02-06T22:57:33.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 20 client.4853.objecter shutdown clearing up homeless session... 2021-02-06T22:57:33.745 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 10 client.4853.objecter successfully canceled tick 2021-02-06T22:57:33.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.106:6812/33219 conn(0x7f7140030740 legacy=0x7f7140032c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 >> v1:172.21.15.51:6790/0 conn(0x7f716008fa70 legacy=0x7f716012b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 shutdown_connections 2021-02-06T22:57:33.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 >> 172.21.15.51:0/2972558144 conn(0x7f7160096860 msgr2=0x7f7160093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.746 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 shutdown_connections 2021-02-06T22:57:33.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.745+0000 7f71686e5700 1 -- 172.21.15.51:0/2972558144 wait complete. 2021-02-06T22:57:33.747 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.746+0000 7f71686e5700 1 librados: shutdown 2021-02-06T22:57:33.747 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 1 to deep-scrub 2021-02-06T22:57:33.756 INFO:tasks.ceph:Scrubbing osd.2 2021-02-06T22:57:33.756 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:33.882 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.883+0000 7fa673b2c700 1 Processor -- start 2021-02-06T22:57:33.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.883+0000 7fa673b2c700 1 -- start start 2021-02-06T22:57:33.883 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa673b2c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0944b0 con 0x7fa66c08f600 2021-02-06T22:57:33.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa673b2c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c090fc0 con 0x7fa66c092c50 2021-02-06T22:57:33.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa673b2c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c091260 con 0x7fa66c12cef0 2021-02-06T22:57:33.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa6718c8700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 0x7fa66c093da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32830/0 (socket says 172.21.15.51:32830) 2021-02-06T22:57:33.884 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa6718c8700 1 -- 172.21.15.51:0/3643493239 learned_addr learned my addr 172.21.15.51:0/3643493239 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.885 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.884+0000 7fa6720c9700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fa66c12cef0 0x7fa66c12f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33176/0 (socket says 172.21.15.51:33176) 2021-02-06T22:57:33.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6718c8700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 legacy=0x7fa66c093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6720c9700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.51:6790/0 conn(0x7fa66c12cef0 legacy=0x7fa66c12f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6710c7700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.106:6789/0 conn(0x7fa66c092c50 legacy=0x7fa66c0930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.888 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746014770 0 0) 0x7fa66c0944b0 con 0x7fa66c08f600 2021-02-06T22:57:33.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa654003230 con 0x7fa66c08f600 2021-02-06T22:57:33.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249961709 0 0) 0x7fa66c091260 con 0x7fa66c12cef0 2021-02-06T22:57:33.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c0944b0 con 0x7fa66c12cef0 2021-02-06T22:57:33.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979801004 0 0) 0x7fa66c090fc0 con 0x7fa66c092c50 2021-02-06T22:57:33.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c091260 con 0x7fa66c092c50 2021-02-06T22:57:33.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 951364053 0 0) 0x7fa654003230 con 0x7fa66c08f600 2021-02-06T22:57:33.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.51:6790/0 conn(0x7fa66c12cef0 legacy=0x7fa66c12f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.886+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.106:6789/0 conn(0x7fa66c092c50 legacy=0x7fa66c0930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c091500 con 0x7fa66c08f600 2021-02-06T22:57:33.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa65c001930 con 0x7fa66c08f600 2021-02-06T22:57:33.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa65c001c40 con 0x7fa66c08f600 2021-02-06T22:57:33.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa6708c6700 1 -- 172.21.15.51:0/3643493239 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa65c004750 con 0x7fa66c08f600 2021-02-06T22:57:33.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa673b2c700 1 -- 172.21.15.51:0/3643493239 >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 legacy=0x7fa66c093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa673b2c700 1 -- 172.21.15.51:0/3643493239 shutdown_connections 2021-02-06T22:57:33.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa673b2c700 1 -- 172.21.15.51:0/3643493239 >> 172.21.15.51:0/3643493239 conn(0x7fa66c099460 msgr2=0x7fa66c099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa673b2c700 1 -- 172.21.15.51:0/3643493239 shutdown_connections 2021-02-06T22:57:33.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.887+0000 7fa673b2c700 1 -- 172.21.15.51:0/3643493239 wait complete. 2021-02-06T22:57:33.892 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 librados: starting msgr at 2021-02-06T22:57:33.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 librados: starting objecter 2021-02-06T22:57:33.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 Processor -- start 2021-02-06T22:57:33.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 -- start start 2021-02-06T22:57:33.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 librados: setting wanted keys 2021-02-06T22:57:33.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 librados: calling monclient init 2021-02-06T22:57:33.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c114770 con 0x7fa66c08f600 2021-02-06T22:57:33.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c1149a0 con 0x7fa66c092c50 2021-02-06T22:57:33.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.888+0000 7fa673b2c700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c067ea0 con 0x7fa66c12cef0 2021-02-06T22:57:33.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.889+0000 7fa6718c8700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 0x7fa66c125f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32836/0 (socket says 172.21.15.51:32836) 2021-02-06T22:57:33.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.889+0000 7fa6718c8700 1 -- 172.21.15.51:0/4225595262 learned_addr learned my addr 172.21.15.51:0/4225595262 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:33.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa6718c8700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 legacy=0x7fa66c125f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter ms_handle_connect 0x7fa66c08f600 2021-02-06T22:57:33.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa6720c9700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.51:6790/0 conn(0x7fa66c12cef0 legacy=0x7fa66c1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter ms_handle_connect 0x7fa66c12cef0 2021-02-06T22:57:33.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa6710c7700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.106:6789/0 conn(0x7fa66c092c50 legacy=0x7fa66c13ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:33.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321444801 0 0) 0x7fa66c114770 con 0x7fa66c08f600 2021-02-06T22:57:33.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c004bd0 con 0x7fa66c08f600 2021-02-06T22:57:33.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter ms_handle_connect 0x7fa66c092c50 2021-02-06T22:57:33.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:33.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611258198 0 0) 0x7fa66c067ea0 con 0x7fa66c12cef0 2021-02-06T22:57:33.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c114770 con 0x7fa66c12cef0 2021-02-06T22:57:33.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 427159491 0 0) 0x7fa64c004bd0 con 0x7fa66c08f600 2021-02-06T22:57:33.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa66c067ea0 con 0x7fa66c08f600 2021-02-06T22:57:33.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa65c0018f0 con 0x7fa66c08f600 2021-02-06T22:57:33.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266586808 0 0) 0x7fa66c1149a0 con 0x7fa66c092c50 2021-02-06T22:57:33.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c004bd0 con 0x7fa66c092c50 2021-02-06T22:57:33.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 14311017 0 0) 0x7fa66c114770 con 0x7fa66c12cef0 2021-02-06T22:57:33.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa66c1149a0 con 0x7fa66c12cef0 2021-02-06T22:57:33.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa664001d10 con 0x7fa66c12cef0 2021-02-06T22:57:33.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 547620062 0 0) 0x7fa66c067ea0 con 0x7fa66c08f600 2021-02-06T22:57:33.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.51:6790/0 conn(0x7fa66c12cef0 legacy=0x7fa66c1422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.106:6789/0 conn(0x7fa66c092c50 legacy=0x7fa66c13ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c067200 con 0x7fa66c08f600 2021-02-06T22:57:33.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c113e40 con 0x7fa66c08f600 2021-02-06T22:57:33.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fa65c004d00 con 0x7fa66c08f600 2021-02-06T22:57:33.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.891+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fa65c005010 con 0x7fa66c08f600 2021-02-06T22:57:33.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 10 client.4887.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:33.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c1268a0 con 0x7fa66c08f600 2021-02-06T22:57:33.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 1 librados: init done 2021-02-06T22:57:33.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fa65c00d7d0 con 0x7fa66c08f600 2021-02-06T22:57:33.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 10 client.4887.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:33.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 15 client.4887.objecter _session_command_op_assign -1 1 2021-02-06T22:57:33.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 20 client.4887.objecter _get_session osd=-1 returning homeless 2021-02-06T22:57:33.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 10 client.4887.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:33.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa66c068aa0 con 0x7fa66c08f600 2021-02-06T22:57:33.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fa65c0395d0 con 0x7fa66c08f600 2021-02-06T22:57:33.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 10 client.4887.objecter ms_dispatch 0x7fa66c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:33.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 3 client.4887.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:33.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 3 client.4887.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:33.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.892+0000 7fa659ffb700 10 client.4887.objecter checking command 1 2021-02-06T22:57:33.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter _get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 15 client.4887.objecter _session_command_op_remove -1 1 2021-02-06T22:57:33.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter _get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 15 client.4887.objecter _session_command_op_assign 2 1 2021-02-06T22:57:33.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 4 2021-02-06T22:57:33.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 10 client.4887.objecter _send_command 1 2021-02-06T22:57:33.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6808/33693 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa64c03ae60 con 0x7fa64c0371d0 2021-02-06T22:57:33.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 20 client.4887.objecter dump_active .. 0 homeless 2021-02-06T22:57:33.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.893+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7fa65c012580 con 0x7fa66c08f600 2021-02-06T22:57:33.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.895+0000 7fa659ffb700 10 client.4887.objecter ms_handle_connect 0x7fa64c0306f0 2021-02-06T22:57:33.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.897+0000 7fa659ffb700 10 client.4887.objecter ms_handle_connect 0x7fa64c0371d0 2021-02-06T22:57:33.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.898+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== osd.2 v1:172.21.15.51:6808/33693 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7fa64c03ae60 con 0x7fa64c0371d0 2021-02-06T22:57:33.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.898+0000 7fa659ffb700 10 client.4887.objecter ms_dispatch 0x7fa66c001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:33.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.898+0000 7fa659ffb700 10 client.4887.objecter _finish_command 1 = system:0 2021-02-06T22:57:33.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.898+0000 7fa659ffb700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 4 2021-02-06T22:57:33.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.898+0000 7fa659ffb700 15 client.4887.objecter _session_command_op_remove 2 1 2021-02-06T22:57:33.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 10 client.4887.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:33.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 15 client.4887.objecter _session_command_op_assign -1 2 2021-02-06T22:57:33.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 20 client.4887.objecter _get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 20 client.4887.objecter _get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 15 client.4887.objecter _session_command_op_remove -1 2 2021-02-06T22:57:33.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 20 client.4887.objecter get_session s=0x7fa64c036b20 osd=2 3 2021-02-06T22:57:33.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 15 client.4887.objecter _session_command_op_assign 2 2 2021-02-06T22:57:33.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 4 2021-02-06T22:57:33.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 10 client.4887.objecter _send_command 2 2021-02-06T22:57:33.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.913+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 --> v1:172.21.15.51:6808/33693 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa66c0581b0 con 0x7fa64c0371d0 2021-02-06T22:57:33.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa659ffb700 1 -- 172.21.15.51:0/4225595262 <== osd.2 v1:172.21.15.51:6808/33693 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7fa66c0581b0 con 0x7fa64c0371d0 2021-02-06T22:57:33.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa659ffb700 10 client.4887.objecter ms_dispatch 0x7fa66c001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:33.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa659ffb700 10 client.4887.objecter _finish_command 2 = system:0 2021-02-06T22:57:33.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa659ffb700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 4 2021-02-06T22:57:33.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa659ffb700 15 client.4887.objecter _session_command_op_remove 2 2 2021-02-06T22:57:33.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 10 librados: watch_flush enter 2021-02-06T22:57:33.917 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 10 librados: watch_flush exit 2021-02-06T22:57:33.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 10 client.4887.objecter close_session for osd.2 2021-02-06T22:57:33.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.51:6808/33693 conn(0x7fa64c0371d0 legacy=0x7fa64c0395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 20 client.4887.objecter put_session s=0x7fa64c036b20 osd=2 1 2021-02-06T22:57:33.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 20 client.4887.objecter shutdown clearing up homeless session... 2021-02-06T22:57:33.918 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 10 client.4887.objecter successfully canceled tick 2021-02-06T22:57:33.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.106:6812/33219 conn(0x7fa64c0306f0 legacy=0x7fa64c032bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 >> v1:172.21.15.51:6789/0 conn(0x7fa66c08f600 legacy=0x7fa66c125f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:33.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa6720c9700 1 -- 172.21.15.51:0/4225595262 reap_dead start 2021-02-06T22:57:33.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 shutdown_connections 2021-02-06T22:57:33.919 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 >> 172.21.15.51:0/4225595262 conn(0x7fa66c099460 msgr2=0x7fa66c098a90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:33.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 shutdown_connections 2021-02-06T22:57:33.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 -- 172.21.15.51:0/4225595262 wait complete. 2021-02-06T22:57:33.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:33.914+0000 7fa673b2c700 1 librados: shutdown 2021-02-06T22:57:33.920 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:33.921 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:33.921 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:33.924 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2021-02-06T22:57:34.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.047+0000 7f5560bc9700 1 Processor -- start 2021-02-06T22:57:34.047 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f5560bc9700 1 -- start start 2021-02-06T22:57:34.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f5560bc9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c095440 con 0x7f555c12ce00 2021-02-06T22:57:34.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f5560bc9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c0907b0 con 0x7f555c092bf0 2021-02-06T22:57:34.048 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f5560bc9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c091010 con 0x7f555c08fa70 2021-02-06T22:57:34.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f555ad9d700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f555c12ce00 0x7f555c12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32850/0 (socket says 172.21.15.51:32850) 2021-02-06T22:57:34.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f555a59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f555c08fa70 0x7f555c0921a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33188/0 (socket says 172.21.15.51:33188) 2021-02-06T22:57:34.049 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.048+0000 7f555ad9d700 1 -- 172.21.15.51:0/870259280 learned_addr learned my addr 172.21.15.51:0/870259280 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.052 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555a59c700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.51:6790/0 conn(0x7f555c08fa70 legacy=0x7f555c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.052 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555ad9d700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.51:6789/0 conn(0x7f555c12ce00 legacy=0x7f555c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.052 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f5559d9b700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.106:6789/0 conn(0x7f555c092bf0 legacy=0x7f555c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.052 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194827638 0 0) 0x7f555c095440 con 0x7f555c12ce00 2021-02-06T22:57:34.053 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5540003230 con 0x7f555c12ce00 2021-02-06T22:57:34.053 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417405669 0 0) 0x7f555c091010 con 0x7f555c08fa70 2021-02-06T22:57:34.053 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f555c095440 con 0x7f555c08fa70 2021-02-06T22:57:34.053 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 512218327 0 0) 0x7f5540003230 con 0x7f555c12ce00 2021-02-06T22:57:34.053 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.51:6790/0 conn(0x7f555c08fa70 legacy=0x7f555c0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.054 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.106:6789/0 conn(0x7f555c092bf0 legacy=0x7f555c0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.054 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c0912b0 con 0x7f555c12ce00 2021-02-06T22:57:34.054 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5554001cb0 con 0x7f555c12ce00 2021-02-06T22:57:34.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5554001fc0 con 0x7f555c12ce00 2021-02-06T22:57:34.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.051+0000 7f555959a700 1 -- 172.21.15.51:0/870259280 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5554004ad0 con 0x7f555c12ce00 2021-02-06T22:57:34.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.052+0000 7f5560bc9700 1 -- 172.21.15.51:0/870259280 >> v1:172.21.15.51:6789/0 conn(0x7f555c12ce00 legacy=0x7f555c12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.055 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.052+0000 7f5560bc9700 1 -- 172.21.15.51:0/870259280 shutdown_connections 2021-02-06T22:57:34.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.052+0000 7f5560bc9700 1 -- 172.21.15.51:0/870259280 >> 172.21.15.51:0/870259280 conn(0x7f555c096860 msgr2=0x7f555c099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.052+0000 7f5560bc9700 1 -- 172.21.15.51:0/870259280 shutdown_connections 2021-02-06T22:57:34.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.052+0000 7f5560bc9700 1 -- 172.21.15.51:0/870259280 wait complete. 2021-02-06T22:57:34.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 librados: starting msgr at 2021-02-06T22:57:34.056 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 librados: starting objecter 2021-02-06T22:57:34.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 Processor -- start 2021-02-06T22:57:34.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 -- start start 2021-02-06T22:57:34.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 librados: setting wanted keys 2021-02-06T22:57:34.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 librados: calling monclient init 2021-02-06T22:57:34.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c12cc30 con 0x7f555c08fa70 2021-02-06T22:57:34.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c1290d0 con 0x7f555c092bf0 2021-02-06T22:57:34.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f5560bc9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555c126d70 con 0x7f555c12ce00 2021-02-06T22:57:34.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f555a59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f555c08fa70 0x7f555c125f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32852/0 (socket says 172.21.15.51:32852) 2021-02-06T22:57:34.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.053+0000 7f555a59c700 1 -- 172.21.15.51:0/314406622 learned_addr learned my addr 172.21.15.51:0/314406622 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f555ad9d700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.51:6790/0 conn(0x7f555c12ce00 legacy=0x7f555c1402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f555a59c700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.51:6789/0 conn(0x7f555c08fa70 legacy=0x7f555c125f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter ms_handle_connect 0x7f555c12ce00 2021-02-06T22:57:34.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter ms_handle_connect 0x7f555c08fa70 2021-02-06T22:57:34.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082082874 0 0) 0x7f555c126d70 con 0x7f555c12ce00 2021-02-06T22:57:34.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538004bd0 con 0x7f555c12ce00 2021-02-06T22:57:34.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130330206 0 0) 0x7f555c12cc30 con 0x7f555c08fa70 2021-02-06T22:57:34.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f555c126d70 con 0x7f555c08fa70 2021-02-06T22:57:34.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter ms_handle_connect 0x7f555c092bf0 2021-02-06T22:57:34.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f5559d9b700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.106:6789/0 conn(0x7f555c092bf0 legacy=0x7f555c126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1957792241 0 0) 0x7f555c126d70 con 0x7f555c08fa70 2021-02-06T22:57:34.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f555c12cc30 con 0x7f555c08fa70 2021-02-06T22:57:34.065 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f55500019b0 con 0x7f555c08fa70 2021-02-06T22:57:34.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2599711914 0 0) 0x7f5538004bd0 con 0x7f555c12ce00 2021-02-06T22:57:34.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f555c126d70 con 0x7f555c12ce00 2021-02-06T22:57:34.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212604938 0 0) 0x7f555c1290d0 con 0x7f555c092bf0 2021-02-06T22:57:34.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538004bd0 con 0x7f555c092bf0 2021-02-06T22:57:34.066 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5554001c70 con 0x7f555c12ce00 2021-02-06T22:57:34.067 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1772076455 0 0) 0x7f555c12cc30 con 0x7f555c08fa70 2021-02-06T22:57:34.067 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.51:6790/0 conn(0x7f555c12ce00 legacy=0x7f555c1402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.067 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.106:6789/0 conn(0x7f555c092bf0 legacy=0x7f555c126660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.067 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555c126f00 con 0x7f555c08fa70 2021-02-06T22:57:34.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c129490 con 0x7f555c08fa70 2021-02-06T22:57:34.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f5560bc9700 10 client.4893.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f555c127c00 con 0x7f555c08fa70 2021-02-06T22:57:34.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f5560bc9700 1 librados: init done 2021-02-06T22:57:34.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5550004920 con 0x7f555c08fa70 2021-02-06T22:57:34.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.056+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5550004c30 con 0x7f555c08fa70 2021-02-06T22:57:34.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f5550004e10 con 0x7f555c08fa70 2021-02-06T22:57:34.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f55500395d0 con 0x7f555c08fa70 2021-02-06T22:57:34.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 10 client.4893.objecter ms_dispatch 0x7f555c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:34.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 3 client.4893.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:34.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 3 client.4893.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:34.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f554a7fc700 20 client.4893.objecter dump_active .. 0 homeless 2021-02-06T22:57:34.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.057+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c004d60 con 0x7f555c08fa70 2021-02-06T22:57:34.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.060+0000 7f554a7fc700 10 client.4893.objecter ms_handle_connect 0x7f5538030780 2021-02-06T22:57:34.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.061+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f55500124c0 con 0x7f555c08fa70 2021-02-06T22:57:34.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.248+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f553c000b50 con 0x7f5538030780 2021-02-06T22:57:34.248 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.248+0000 7f554a7fc700 1 -- 172.21.15.51:0/314406622 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f553c000b50 con 0x7f5538030780 2021-02-06T22:57:34.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 10 librados: watch_flush enter 2021-02-06T22:57:34.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 10 librados: watch_flush exit 2021-02-06T22:57:34.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 20 client.4893.objecter shutdown clearing up homeless session... 2021-02-06T22:57:34.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 10 client.4893.objecter successfully canceled tick 2021-02-06T22:57:34.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.106:6812/33219 conn(0x7f5538030780 legacy=0x7f5538032c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 >> v1:172.21.15.51:6789/0 conn(0x7f555c08fa70 legacy=0x7f555c125f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 shutdown_connections 2021-02-06T22:57:34.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 >> 172.21.15.51:0/314406622 conn(0x7f555c096860 msgr2=0x7f555c122e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 shutdown_connections 2021-02-06T22:57:34.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.250+0000 7f5560bc9700 1 -- 172.21.15.51:0/314406622 wait complete. 2021-02-06T22:57:34.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.251+0000 7f5560bc9700 1 librados: shutdown 2021-02-06T22:57:34.252 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 2 to deep-scrub 2021-02-06T22:57:34.261 INFO:tasks.ceph:Scrubbing osd.3 2021-02-06T22:57:34.262 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:34.387 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.388+0000 7f6f30bc8700 1 Processor -- start 2021-02-06T22:57:34.388 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.388+0000 7f6f30bc8700 1 -- start start 2021-02-06T22:57:34.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f30bc8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c095020 con 0x7f6f2c08f390 2021-02-06T22:57:34.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f30bc8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c0952c0 con 0x7f6f2c08f840 2021-02-06T22:57:34.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f30bc8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c095560 con 0x7f6f2c092a20 2021-02-06T22:57:34.389 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f2a59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 0x7f6f2c08ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33206/0 (socket says 172.21.15.51:33206) 2021-02-06T22:57:34.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f2a59c700 1 -- 172.21.15.51:0/1945478933 learned_addr learned my addr 172.21.15.51:0/1945478933 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.390 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.389+0000 7f6f29d9b700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 0x7f6f2c12d780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32866/0 (socket says 172.21.15.51:32866) 2021-02-06T22:57:34.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f2a59c700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 legacy=0x7f6f2c08ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f29d9b700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 legacy=0x7f6f2c12d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.392 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887951499 0 0) 0x7f6f2c095020 con 0x7f6f2c08f390 2021-02-06T22:57:34.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f10003230 con 0x7f6f2c08f390 2021-02-06T22:57:34.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044973671 0 0) 0x7f6f2c095560 con 0x7f6f2c092a20 2021-02-06T22:57:34.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.391+0000 7f6f2ad9d700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.106:6789/0 conn(0x7f6f2c08f840 legacy=0x7f6f2c130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f2c095020 con 0x7f6f2c092a20 2021-02-06T22:57:34.393 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2536316363 0 0) 0x7f6f10003230 con 0x7f6f2c08f390 2021-02-06T22:57:34.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 legacy=0x7f6f2c08ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.106:6789/0 conn(0x7f6f2c08f840 legacy=0x7f6f2c130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c068250 con 0x7f6f2c08f390 2021-02-06T22:57:34.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f20001930 con 0x7f6f2c08f390 2021-02-06T22:57:34.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f29d9b700 1 --1- 172.21.15.51:0/1945478933 >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 0x7f6f2c12d780 :-1 s=OPENED pgs=354 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f6f20004690 mon_map magic: 0 v1 2021-02-06T22:57:34.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6f20001c40 con 0x7f6f2c08f390 2021-02-06T22:57:34.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f30bc8700 1 -- 172.21.15.51:0/1945478933 >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 legacy=0x7f6f2c12d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f2959a700 1 -- 172.21.15.51:0/1945478933 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f20004690 con 0x7f6f2c08f390 2021-02-06T22:57:34.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f30bc8700 1 -- 172.21.15.51:0/1945478933 shutdown_connections 2021-02-06T22:57:34.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.392+0000 7f6f30bc8700 1 -- 172.21.15.51:0/1945478933 >> 172.21.15.51:0/1945478933 conn(0x7f6f2c099460 msgr2=0x7f6f2c099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 -- 172.21.15.51:0/1945478933 shutdown_connections 2021-02-06T22:57:34.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 -- 172.21.15.51:0/1945478933 wait complete. 2021-02-06T22:57:34.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 librados: starting msgr at 2021-02-06T22:57:34.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 librados: starting objecter 2021-02-06T22:57:34.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 Processor -- start 2021-02-06T22:57:34.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 -- start start 2021-02-06T22:57:34.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 librados: setting wanted keys 2021-02-06T22:57:34.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.393+0000 7f6f30bc8700 1 librados: calling monclient init 2021-02-06T22:57:34.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.394+0000 7f6f30bc8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c12baa0 con 0x7f6f2c08f390 2021-02-06T22:57:34.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.394+0000 7f6f30bc8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c12bd40 con 0x7f6f2c08f840 2021-02-06T22:57:34.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.394+0000 7f6f30bc8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c12bfe0 con 0x7f6f2c092a20 2021-02-06T22:57:34.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.394+0000 7f6f2a59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 0x7f6f2c137890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32870/0 (socket says 172.21.15.51:32870) 2021-02-06T22:57:34.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.394+0000 7f6f2a59c700 1 -- 172.21.15.51:0/3610899095 learned_addr learned my addr 172.21.15.51:0/3610899095 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f2ad9d700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 legacy=0x7f6f2c13fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter ms_handle_connect 0x7f6f2c092a20 2021-02-06T22:57:34.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f2a59c700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 legacy=0x7f6f2c137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter ms_handle_connect 0x7f6f2c08f390 2021-02-06T22:57:34.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter ms_handle_connect 0x7f6f2c08f840 2021-02-06T22:57:34.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f29d9b700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.106:6789/0 conn(0x7f6f2c08f840 legacy=0x7f6f2c1314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f2ad9d700 1 --1- 172.21.15.51:0/3610899095 >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 0x7f6f2c13fbe0 :-1 s=OPENED pgs=328 cs=1 l=1).queue_received will delay after 1.61265e+09 on 0x7f6f2c12bfe0 auth_reply(proto 2 0 (0) Success) v1 2021-02-06T22:57:34.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321935635 0 0) 0x7f6f2c12baa0 con 0x7f6f2c08f390 2021-02-06T22:57:34.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f08004bd0 con 0x7f6f2c08f390 2021-02-06T22:57:34.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959113469 0 0) 0x7f6f2c12bd40 con 0x7f6f2c08f840 2021-02-06T22:57:34.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f2c12baa0 con 0x7f6f2c08f840 2021-02-06T22:57:34.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.396+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2707144165 0 0) 0x7f6f08004bd0 con 0x7f6f2c08f390 2021-02-06T22:57:34.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6f2c12bd40 con 0x7f6f2c08f390 2021-02-06T22:57:34.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f1c0044f0 con 0x7f6f2c08f390 2021-02-06T22:57:34.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2092074362 0 0) 0x7f6f2c12bd40 con 0x7f6f2c08f390 2021-02-06T22:57:34.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.51:6790/0 conn(0x7f6f2c092a20 legacy=0x7f6f2c13fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.106:6789/0 conn(0x7f6f2c08f840 legacy=0x7f6f2c1314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c129e70 con 0x7f6f2c08f390 2021-02-06T22:57:34.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566328576 0 0) 0x7f6f2c12bfe0 con 0x7f6f2c092a20 2021-02-06T22:57:34.406 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c137fa0 con 0x7f6f2c08f390 2021-02-06T22:57:34.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f30bc8700 10 client.4899.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c131da0 con 0x7f6f2c08f390 2021-02-06T22:57:34.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f30bc8700 1 librados: init done 2021-02-06T22:57:34.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f6f1c0049c0 con 0x7f6f2c08f390 2021-02-06T22:57:34.407 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f6f1c004cd0 con 0x7f6f2c08f390 2021-02-06T22:57:34.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.397+0000 7f6f30bc8700 10 client.4899.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:34.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f30bc8700 15 client.4899.objecter _session_command_op_assign -1 1 2021-02-06T22:57:34.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f30bc8700 20 client.4899.objecter _get_session osd=-1 returning homeless 2021-02-06T22:57:34.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f30bc8700 10 client.4899.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.408 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.51:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f0c002870 con 0x7f6f2c08f390 2021-02-06T22:57:34.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f6f1c004e30 con 0x7f6f2c08f390 2021-02-06T22:57:34.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f6f1c039590 con 0x7f6f2c08f390 2021-02-06T22:57:34.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 10 client.4899.objecter ms_dispatch 0x7f6f2c001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:34.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 3 client.4899.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:34.409 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 3 client.4899.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:34.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 10 client.4899.objecter checking command 1 2021-02-06T22:57:34.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter _get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 15 client.4899.objecter _session_command_op_remove -1 1 2021-02-06T22:57:34.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter _get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 15 client.4899.objecter _session_command_op_assign 3 1 2021-02-06T22:57:34.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 4 2021-02-06T22:57:34.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 10 client.4899.objecter _send_command 1 2021-02-06T22:57:34.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.106:6804/33663 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f0803aba0 con 0x7f6f08036f10 2021-02-06T22:57:34.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 20 client.4899.objecter dump_active .. 0 homeless 2021-02-06T22:57:34.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.398+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f6f1c039a00 con 0x7f6f2c08f390 2021-02-06T22:57:34.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.400+0000 7f6f1a7fc700 10 client.4899.objecter ms_handle_connect 0x7f6f080303b0 2021-02-06T22:57:34.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.403+0000 7f6f1a7fc700 10 client.4899.objecter ms_handle_connect 0x7f6f08036f10 2021-02-06T22:57:34.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.404+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== osd.3 v1:172.21.15.106:6804/33663 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f6f0803aba0 con 0x7f6f08036f10 2021-02-06T22:57:34.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.404+0000 7f6f1a7fc700 10 client.4899.objecter ms_dispatch 0x7f6f2c001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:34.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.404+0000 7f6f1a7fc700 10 client.4899.objecter _finish_command 1 = system:0 2021-02-06T22:57:34.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.404+0000 7f6f1a7fc700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 4 2021-02-06T22:57:34.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.404+0000 7f6f1a7fc700 15 client.4899.objecter _session_command_op_remove 3 1 2021-02-06T22:57:34.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 10 client.4899.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:34.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 15 client.4899.objecter _session_command_op_assign -1 2 2021-02-06T22:57:34.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 20 client.4899.objecter _get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 20 client.4899.objecter _get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 15 client.4899.objecter _session_command_op_remove -1 2 2021-02-06T22:57:34.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 20 client.4899.objecter get_session s=0x7f6f08036860 osd=3 3 2021-02-06T22:57:34.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 15 client.4899.objecter _session_command_op_assign 3 2 2021-02-06T22:57:34.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 4 2021-02-06T22:57:34.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 10 client.4899.objecter _send_command 2 2021-02-06T22:57:34.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.419+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 --> v1:172.21.15.106:6804/33663 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6f0c001160 con 0x7f6f08036f10 2021-02-06T22:57:34.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f1a7fc700 1 -- 172.21.15.51:0/3610899095 <== osd.3 v1:172.21.15.106:6804/33663 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f6f0c001160 con 0x7f6f08036f10 2021-02-06T22:57:34.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f1a7fc700 10 client.4899.objecter ms_dispatch 0x7f6f2c001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:34.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f1a7fc700 10 client.4899.objecter _finish_command 2 = system:0 2021-02-06T22:57:34.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f1a7fc700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 4 2021-02-06T22:57:34.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f1a7fc700 15 client.4899.objecter _session_command_op_remove 3 2 2021-02-06T22:57:34.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 10 librados: watch_flush enter 2021-02-06T22:57:34.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 10 librados: watch_flush exit 2021-02-06T22:57:34.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 10 client.4899.objecter close_session for osd.3 2021-02-06T22:57:34.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.106:6804/33663 conn(0x7f6f08036f10 legacy=0x7f6f08039330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 20 client.4899.objecter put_session s=0x7f6f08036860 osd=3 1 2021-02-06T22:57:34.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 20 client.4899.objecter shutdown clearing up homeless session... 2021-02-06T22:57:34.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 10 client.4899.objecter successfully canceled tick 2021-02-06T22:57:34.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.106:6812/33219 conn(0x7f6f080303b0 legacy=0x7f6f08032870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 >> v1:172.21.15.51:6789/0 conn(0x7f6f2c08f390 legacy=0x7f6f2c137890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f2ad9d700 1 -- 172.21.15.51:0/3610899095 reap_dead start 2021-02-06T22:57:34.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 shutdown_connections 2021-02-06T22:57:34.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 >> 172.21.15.51:0/3610899095 conn(0x7f6f2c099460 msgr2=0x7f6f2c124330 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 shutdown_connections 2021-02-06T22:57:34.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.420+0000 7f6f30bc8700 1 -- 172.21.15.51:0/3610899095 wait complete. 2021-02-06T22:57:34.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.421+0000 7f6f30bc8700 1 librados: shutdown 2021-02-06T22:57:34.426 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:34.426 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:34.427 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:34.431 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2021-02-06T22:57:34.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.554+0000 7faceff57700 1 Processor -- start 2021-02-06T22:57:34.554 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faceff57700 1 -- start start 2021-02-06T22:57:34.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faceff57700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face808ef70 con 0x7face80908f0 2021-02-06T22:57:34.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faceff57700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face808f440 con 0x7face8090d50 2021-02-06T22:57:34.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faceff57700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face80620b0 con 0x7face8062530 2021-02-06T22:57:34.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faced4f2700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7face80908f0 0x7face812fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32880/0 (socket says 172.21.15.51:32880) 2021-02-06T22:57:34.555 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7facedcf3700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7face8062530 0x7face80619a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33222/0 (socket says 172.21.15.51:33222) 2021-02-06T22:57:34.556 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.555+0000 7faced4f2700 1 -- 172.21.15.51:0/2495641147 learned_addr learned my addr 172.21.15.51:0/2495641147 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.557+0000 7faced4f2700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.51:6789/0 conn(0x7face80908f0 legacy=0x7face812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.557+0000 7facedcf3700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.51:6790/0 conn(0x7face8062530 legacy=0x7face80619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779430434 0 0) 0x7face808ef70 con 0x7face80908f0 2021-02-06T22:57:34.558 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7facee4f4700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facd0003230 con 0x7face80908f0 2021-02-06T22:57:34.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629597950 0 0) 0x7face80620b0 con 0x7face8062530 2021-02-06T22:57:34.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7facee4f4700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2021-02-06T22:57:34.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7facee4f4700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-02-06T22:57:34.559 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7facee4f4700 1 --1- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 0x7face81331e0 :-1 s=OPENED pgs=334 cs=1 l=1).handle_message read tag failed 2021-02-06T22:57:34.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7facee4f4700 1 --1- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 0x7face81331e0 :-1 s=OPENED pgs=334 cs=1 l=1).fault on lossy channel, failing 2021-02-06T22:57:34.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face808ef70 con 0x7face8062530 2021-02-06T22:57:34.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3033640100 0 0) 0x7facd0003230 con 0x7face80908f0 2021-02-06T22:57:34.560 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.51:6790/0 conn(0x7face8062530 legacy=0x7face80619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81331e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2021-02-06T22:57:34.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8096470 con 0x7face80908f0 2021-02-06T22:57:34.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7facd8001930 con 0x7face80908f0 2021-02-06T22:57:34.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7facd8001c40 con 0x7face80908f0 2021-02-06T22:57:34.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceccf1700 1 -- 172.21.15.51:0/2495641147 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7facd8004750 con 0x7face80908f0 2021-02-06T22:57:34.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.558+0000 7faceff57700 1 -- 172.21.15.51:0/2495641147 >> v1:172.21.15.51:6789/0 conn(0x7face80908f0 legacy=0x7face812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 -- 172.21.15.51:0/2495641147 shutdown_connections 2021-02-06T22:57:34.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 -- 172.21.15.51:0/2495641147 >> 172.21.15.51:0/2495641147 conn(0x7face809b010 msgr2=0x7face8096e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 -- 172.21.15.51:0/2495641147 shutdown_connections 2021-02-06T22:57:34.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 -- 172.21.15.51:0/2495641147 wait complete. 2021-02-06T22:57:34.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 librados: starting msgr at 2021-02-06T22:57:34.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 librados: starting objecter 2021-02-06T22:57:34.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 Processor -- start 2021-02-06T22:57:34.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 -- start start 2021-02-06T22:57:34.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 librados: setting wanted keys 2021-02-06T22:57:34.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.559+0000 7faceff57700 1 librados: calling monclient init 2021-02-06T22:57:34.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.560+0000 7faceff57700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face813ae50 con 0x7face80908f0 2021-02-06T22:57:34.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.560+0000 7faceff57700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face8124220 con 0x7face8090d50 2021-02-06T22:57:34.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.560+0000 7faceff57700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face81244c0 con 0x7face8062530 2021-02-06T22:57:34.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.560+0000 7facedcf3700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7face8062530 0x7face813a030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33228/0 (socket says 172.21.15.51:33228) 2021-02-06T22:57:34.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.560+0000 7facedcf3700 1 -- 172.21.15.51:0/968314635 learned_addr learned my addr 172.21.15.51:0/968314635 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7faced4f2700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.51:6789/0 conn(0x7face80908f0 legacy=0x7face813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facedcf3700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.51:6790/0 conn(0x7face8062530 legacy=0x7face813a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter ms_handle_connect 0x7face80908f0 2021-02-06T22:57:34.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter ms_handle_connect 0x7face8062530 2021-02-06T22:57:34.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615117799 0 0) 0x7face813ae50 con 0x7face80908f0 2021-02-06T22:57:34.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc8004bd0 con 0x7face80908f0 2021-02-06T22:57:34.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352427974 0 0) 0x7face81244c0 con 0x7face8062530 2021-02-06T22:57:34.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face813ae50 con 0x7face8062530 2021-02-06T22:57:34.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter ms_handle_connect 0x7face8090d50 2021-02-06T22:57:34.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facee4f4700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.562+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799017825 0 0) 0x7face8124220 con 0x7face8090d50 2021-02-06T22:57:34.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face81244c0 con 0x7face8090d50 2021-02-06T22:57:34.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3985356868 0 0) 0x7facc8004bd0 con 0x7face80908f0 2021-02-06T22:57:34.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7face8124220 con 0x7face80908f0 2021-02-06T22:57:34.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7facd80018f0 con 0x7face80908f0 2021-02-06T22:57:34.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4109976061 0 0) 0x7face813ae50 con 0x7face8062530 2021-02-06T22:57:34.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7facc8004bd0 con 0x7face8062530 2021-02-06T22:57:34.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7face4001c60 con 0x7face8062530 2021-02-06T22:57:34.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2695105916 0 0) 0x7face8124220 con 0x7face80908f0 2021-02-06T22:57:34.572 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.51:6790/0 conn(0x7face8062530 legacy=0x7face813a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.106:6789/0 conn(0x7face8090d50 legacy=0x7face81423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8122370 con 0x7face80908f0 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face812ade0 con 0x7face80908f0 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7facd80012e0 con 0x7face80908f0 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7facd8004e60 con 0x7face80908f0 2021-02-06T22:57:34.573 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7faceff57700 10 client.4905.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7face8124ac0 con 0x7face80908f0 2021-02-06T22:57:34.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.563+0000 7faceff57700 1 librados: init done 2021-02-06T22:57:34.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7facd800d6a0 con 0x7face80908f0 2021-02-06T22:57:34.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7facd8039450 con 0x7face80908f0 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 10 client.4905.objecter ms_dispatch 0x7face8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 3 client.4905.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 3 client.4905.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7facd5ffb700 20 client.4905.objecter dump_active .. 0 homeless 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.564+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8096e50 con 0x7face80908f0 2021-02-06T22:57:34.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.566+0000 7facd5ffb700 10 client.4905.objecter ms_handle_connect 0x7facc8030470 2021-02-06T22:57:34.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.568+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7facd80123a0 con 0x7face80908f0 2021-02-06T22:57:34.748 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.749+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7face80956a0 con 0x7facc8030470 2021-02-06T22:57:34.749 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.750+0000 7facd5ffb700 1 -- 172.21.15.51:0/968314635 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7face80956a0 con 0x7facc8030470 2021-02-06T22:57:34.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 10 librados: watch_flush enter 2021-02-06T22:57:34.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 10 librados: watch_flush exit 2021-02-06T22:57:34.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 20 client.4905.objecter shutdown clearing up homeless session... 2021-02-06T22:57:34.751 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 10 client.4905.objecter successfully canceled tick 2021-02-06T22:57:34.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.106:6812/33219 conn(0x7facc8030470 legacy=0x7facc8032930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 >> v1:172.21.15.51:6789/0 conn(0x7face80908f0 legacy=0x7face813a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 shutdown_connections 2021-02-06T22:57:34.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.751+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 >> 172.21.15.51:0/968314635 conn(0x7face809b010 msgr2=0x7face8126050 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.752 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.752+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 shutdown_connections 2021-02-06T22:57:34.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.752+0000 7faceff57700 1 -- 172.21.15.51:0/968314635 wait complete. 2021-02-06T22:57:34.753 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.752+0000 7faceff57700 1 librados: shutdown 2021-02-06T22:57:34.753 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 3 to deep-scrub 2021-02-06T22:57:34.762 INFO:tasks.ceph:Scrubbing osd.4 2021-02-06T22:57:34.762 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:34.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.890+0000 7f8074cd5700 1 Processor -- start 2021-02-06T22:57:34.889 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.890+0000 7f8074cd5700 1 -- start start 2021-02-06T22:57:34.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f8074cd5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700944b0 con 0x7f807008f600 2021-02-06T22:57:34.890 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f8074cd5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070090fc0 con 0x7f807012cef0 2021-02-06T22:57:34.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f8074cd5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070091260 con 0x7f8070092c50 2021-02-06T22:57:34.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f806e59c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f807008f600 0x7f8070093da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32894/0 (socket says 172.21.15.51:32894) 2021-02-06T22:57:34.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f806dd9b700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f8070092c50 0x7f80700930e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33236/0 (socket says 172.21.15.51:33236) 2021-02-06T22:57:34.891 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.891+0000 7f806e59c700 1 -- 172.21.15.51:0/1510513422 learned_addr learned my addr 172.21.15.51:0/1510513422 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806e59c700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.51:6789/0 conn(0x7f807008f600 legacy=0x7f8070093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806dd9b700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.51:6790/0 conn(0x7f8070092c50 legacy=0x7f80700930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806ed9d700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.106:6789/0 conn(0x7f807012cef0 legacy=0x7f807012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649339062 0 0) 0x7f8070091260 con 0x7f8070092c50 2021-02-06T22:57:34.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8054003230 con 0x7f8070092c50 2021-02-06T22:57:34.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335860435 0 0) 0x7f80700944b0 con 0x7f807008f600 2021-02-06T22:57:34.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8070091260 con 0x7f807008f600 2021-02-06T22:57:34.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49693781 0 0) 0x7f8070090fc0 con 0x7f807012cef0 2021-02-06T22:57:34.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80700944b0 con 0x7f807012cef0 2021-02-06T22:57:34.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 35055496 0 0) 0x7f8054003230 con 0x7f8070092c50 2021-02-06T22:57:34.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.106:6789/0 conn(0x7f807012cef0 legacy=0x7f807012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.51:6789/0 conn(0x7f807008f600 legacy=0x7f8070093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070091500 con 0x7f8070092c50 2021-02-06T22:57:34.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.893+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8064001930 con 0x7f8070092c50 2021-02-06T22:57:34.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8064001c40 con 0x7f8070092c50 2021-02-06T22:57:34.896 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f806d59a700 1 -- 172.21.15.51:0/1510513422 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8064004690 con 0x7f8070092c50 2021-02-06T22:57:34.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f8074cd5700 1 -- 172.21.15.51:0/1510513422 >> v1:172.21.15.51:6790/0 conn(0x7f8070092c50 legacy=0x7f80700930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f8074cd5700 1 -- 172.21.15.51:0/1510513422 shutdown_connections 2021-02-06T22:57:34.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f8074cd5700 1 -- 172.21.15.51:0/1510513422 >> 172.21.15.51:0/1510513422 conn(0x7f8070099460 msgr2=0x7f8070099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f8074cd5700 1 -- 172.21.15.51:0/1510513422 shutdown_connections 2021-02-06T22:57:34.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.894+0000 7f8074cd5700 1 -- 172.21.15.51:0/1510513422 wait complete. 2021-02-06T22:57:34.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 librados: starting msgr at 2021-02-06T22:57:34.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 librados: starting objecter 2021-02-06T22:57:34.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 Processor -- start 2021-02-06T22:57:34.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 -- start start 2021-02-06T22:57:34.902 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 librados: setting wanted keys 2021-02-06T22:57:34.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 librados: calling monclient init 2021-02-06T22:57:34.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070067ea0 con 0x7f807012cef0 2021-02-06T22:57:34.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80701267c0 con 0x7f8070092c50 2021-02-06T22:57:34.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f8074cd5700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070065350 con 0x7f807008f600 2021-02-06T22:57:34.903 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f806e59c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f807008f600 0x7f80701260b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33240/0 (socket says 172.21.15.51:33240) 2021-02-06T22:57:34.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.895+0000 7f806e59c700 1 -- 172.21.15.51:0/1381725828 learned_addr learned my addr 172.21.15.51:0/1381725828 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:34.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f806e59c700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.51:6790/0 conn(0x7f807008f600 legacy=0x7f80701260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f806ed9d700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.51:6789/0 conn(0x7f807012cef0 legacy=0x7f80701423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter ms_handle_connect 0x7f807008f600 2021-02-06T22:57:34.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter ms_handle_connect 0x7f807012cef0 2021-02-06T22:57:34.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715643696 0 0) 0x7f8070067ea0 con 0x7f807012cef0 2021-02-06T22:57:34.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f804c004bd0 con 0x7f807012cef0 2021-02-06T22:57:34.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904636027 0 0) 0x7f8070065350 con 0x7f807008f600 2021-02-06T22:57:34.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f806dd9b700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.106:6789/0 conn(0x7f8070092c50 legacy=0x7f807013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:34.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8070067ea0 con 0x7f807008f600 2021-02-06T22:57:34.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter ms_handle_connect 0x7f8070092c50 2021-02-06T22:57:34.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:34.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745760481 0 0) 0x7f80701267c0 con 0x7f8070092c50 2021-02-06T22:57:34.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8070065350 con 0x7f8070092c50 2021-02-06T22:57:34.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2975905701 0 0) 0x7f8070067ea0 con 0x7f807008f600 2021-02-06T22:57:34.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80701267c0 con 0x7f807008f600 2021-02-06T22:57:34.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f80600044f0 con 0x7f807008f600 2021-02-06T22:57:34.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 182325403 0 0) 0x7f804c004bd0 con 0x7f807012cef0 2021-02-06T22:57:34.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8070067ea0 con 0x7f807012cef0 2021-02-06T22:57:34.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8068001f60 con 0x7f807012cef0 2021-02-06T22:57:34.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4092127951 0 0) 0x7f80701267c0 con 0x7f807008f600 2021-02-06T22:57:34.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.106:6789/0 conn(0x7f8070092c50 legacy=0x7f807013ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.51:6789/0 conn(0x7f807012cef0 legacy=0x7f80701423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070114860 con 0x7f807008f600 2021-02-06T22:57:34.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8070114b00 con 0x7f807008f600 2021-02-06T22:57:34.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f8074cd5700 10 client.4883.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070139920 con 0x7f807008f600 2021-02-06T22:57:34.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.898+0000 7f8074cd5700 1 librados: init done 2021-02-06T22:57:34.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f8060004900 con 0x7f807008f600 2021-02-06T22:57:34.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f8060004c10 con 0x7f807008f600 2021-02-06T22:57:34.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f8074cd5700 10 client.4883.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:34.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f8060004d70 con 0x7f807008f600 2021-02-06T22:57:34.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f8074cd5700 15 client.4883.objecter _session_command_op_assign -1 1 2021-02-06T22:57:34.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f8074cd5700 20 client.4883.objecter _get_session osd=-1 returning homeless 2021-02-06T22:57:34.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f8074cd5700 10 client.4883.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:34.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80700581b0 con 0x7f807008f600 2021-02-06T22:57:34.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f80600394f0 con 0x7f807008f600 2021-02-06T22:57:34.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 10 client.4883.objecter ms_dispatch 0x7f8070001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:34.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 3 client.4883.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:34.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 3 client.4883.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:34.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 10 client.4883.objecter checking command 1 2021-02-06T22:57:34.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter _get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 15 client.4883.objecter _session_command_op_remove -1 1 2021-02-06T22:57:34.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter _get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 15 client.4883.objecter _session_command_op_assign 4 1 2021-02-06T22:57:34.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 4 2021-02-06T22:57:34.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 10 client.4883.objecter _send_command 1 2021-02-06T22:57:34.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.106:6800/33664 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f804c03aed0 con 0x7f804c037240 2021-02-06T22:57:34.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 20 client.4883.objecter dump_active .. 0 homeless 2021-02-06T22:57:34.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.899+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f80600399f0 con 0x7f807008f600 2021-02-06T22:57:34.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.902+0000 7f805e7fc700 10 client.4883.objecter ms_handle_connect 0x7f804c030700 2021-02-06T22:57:34.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.904+0000 7f805e7fc700 10 client.4883.objecter ms_handle_connect 0x7f804c037240 2021-02-06T22:57:34.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.905+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== osd.4 v1:172.21.15.106:6800/33664 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f804c03aed0 con 0x7f804c037240 2021-02-06T22:57:34.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.905+0000 7f805e7fc700 10 client.4883.objecter ms_dispatch 0x7f8070001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:34.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.905+0000 7f805e7fc700 10 client.4883.objecter _finish_command 1 = system:0 2021-02-06T22:57:34.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.905+0000 7f805e7fc700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 4 2021-02-06T22:57:34.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.905+0000 7f805e7fc700 15 client.4883.objecter _session_command_op_remove 4 1 2021-02-06T22:57:34.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 10 client.4883.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:34.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 15 client.4883.objecter _session_command_op_assign -1 2 2021-02-06T22:57:34.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 20 client.4883.objecter _get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.920 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 20 client.4883.objecter _get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 15 client.4883.objecter _session_command_op_remove -1 2 2021-02-06T22:57:34.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 20 client.4883.objecter get_session s=0x7f804c036b90 osd=4 3 2021-02-06T22:57:34.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 15 client.4883.objecter _session_command_op_assign 4 2 2021-02-06T22:57:34.921 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 4 2021-02-06T22:57:34.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 10 client.4883.objecter _send_command 2 2021-02-06T22:57:34.922 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 --> v1:172.21.15.106:6800/33664 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8070090bd0 con 0x7f804c037240 2021-02-06T22:57:34.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f805e7fc700 1 -- 172.21.15.51:0/1381725828 <== osd.4 v1:172.21.15.106:6800/33664 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f8070090bd0 con 0x7f804c037240 2021-02-06T22:57:34.923 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f805e7fc700 10 client.4883.objecter ms_dispatch 0x7f8070001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:34.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f805e7fc700 10 client.4883.objecter _finish_command 2 = system:0 2021-02-06T22:57:34.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f805e7fc700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 4 2021-02-06T22:57:34.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.921+0000 7f805e7fc700 15 client.4883.objecter _session_command_op_remove 4 2 2021-02-06T22:57:34.924 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 10 librados: watch_flush enter 2021-02-06T22:57:34.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 10 librados: watch_flush exit 2021-02-06T22:57:34.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 10 client.4883.objecter close_session for osd.4 2021-02-06T22:57:34.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.106:6800/33664 conn(0x7f804c037240 legacy=0x7f804c039660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 20 client.4883.objecter put_session s=0x7f804c036b90 osd=4 1 2021-02-06T22:57:34.925 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 20 client.4883.objecter shutdown clearing up homeless session... 2021-02-06T22:57:34.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 10 client.4883.objecter successfully canceled tick 2021-02-06T22:57:34.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.106:6812/33219 conn(0x7f804c030700 legacy=0x7f804c032bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 >> v1:172.21.15.51:6790/0 conn(0x7f807008f600 legacy=0x7f80701260b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:34.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f806ed9d700 1 -- 172.21.15.51:0/1381725828 reap_dead start 2021-02-06T22:57:34.926 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 shutdown_connections 2021-02-06T22:57:34.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 >> 172.21.15.51:0/1381725828 conn(0x7f8070099460 msgr2=0x7f8070097e30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:34.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 shutdown_connections 2021-02-06T22:57:34.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 -- 172.21.15.51:0/1381725828 wait complete. 2021-02-06T22:57:34.927 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:34.922+0000 7f8074cd5700 1 librados: shutdown 2021-02-06T22:57:34.927 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:34.928 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:34.928 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:34.932 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2021-02-06T22:57:35.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.057+0000 7fb6fe6f8700 1 Processor -- start 2021-02-06T22:57:35.057 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.057+0000 7fb6fe6f8700 1 -- start start 2021-02-06T22:57:35.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80998a0 con 0x7fb6f8097200 2021-02-06T22:57:35.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f8099b10 con 0x7fb6f8093e80 2021-02-06T22:57:35.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f8099db0 con 0x7fb6f80976b0 2021-02-06T22:57:35.058 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6f77fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fb6f8097200 0x7fb6f812fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32908/0 (socket says 172.21.15.51:32908) 2021-02-06T22:57:35.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6f77fe700 1 -- 172.21.15.51:0/3002889884 learned_addr learned my addr 172.21.15.51:0/3002889884 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.059 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.058+0000 7fb6fcc95700 1 --1- 172.21.15.51:0/3002889884 >> v1:172.21.15.51:6790/0 conn(0x7fb6f80976b0 0x7fb6f81331a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33250/0 (socket says 172.21.15.51:33250) 2021-02-06T22:57:35.060 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6fcc95700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.51:6790/0 conn(0x7fb6f80976b0 legacy=0x7fb6f81331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f77fe700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.51:6789/0 conn(0x7fb6f8097200 legacy=0x7fb6f812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790119784 0 0) 0x7fb6f80998a0 con 0x7fb6f8097200 2021-02-06T22:57:35.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f7fff700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.106:6789/0 conn(0x7fb6f8093e80 legacy=0x7fb6f81278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e4003230 con 0x7fb6f8097200 2021-02-06T22:57:35.061 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497531667 0 0) 0x7fb6f8099db0 con 0x7fb6f80976b0 2021-02-06T22:57:35.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.060+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f80998a0 con 0x7fb6f80976b0 2021-02-06T22:57:35.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2417468621 0 0) 0x7fb6e4003230 con 0x7fb6f8097200 2021-02-06T22:57:35.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.51:6790/0 conn(0x7fb6f80976b0 legacy=0x7fb6f81331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.062 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.106:6789/0 conn(0x7fb6f8093e80 legacy=0x7fb6f81278b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8127480 con 0x7fb6f8097200 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6e8001860 con 0x7fb6f8097200 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb6e8001b70 con 0x7fb6f8097200 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6f6ffd700 1 -- 172.21.15.51:0/3002889884 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6e80045b0 con 0x7fb6f8097200 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/3002889884 >> v1:172.21.15.51:6789/0 conn(0x7fb6f8097200 legacy=0x7fb6f812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.063 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/3002889884 shutdown_connections 2021-02-06T22:57:35.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/3002889884 >> 172.21.15.51:0/3002889884 conn(0x7fb6f809ae00 msgr2=0x7fb6f809d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/3002889884 shutdown_connections 2021-02-06T22:57:35.064 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.061+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/3002889884 wait complete. 2021-02-06T22:57:35.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 librados: starting msgr at 2021-02-06T22:57:35.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 librados: starting objecter 2021-02-06T22:57:35.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 Processor -- start 2021-02-06T22:57:35.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 -- start start 2021-02-06T22:57:35.068 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 librados: setting wanted keys 2021-02-06T22:57:35.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.062+0000 7fb6fe6f8700 1 librados: calling monclient init 2021-02-06T22:57:35.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.063+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80995a0 con 0x7fb6f80976b0 2021-02-06T22:57:35.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.063+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f8122d10 con 0x7fb6f8093e80 2021-02-06T22:57:35.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.063+0000 7fb6fe6f8700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f8122fb0 con 0x7fb6f8097200 2021-02-06T22:57:35.069 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.063+0000 7fb6f77fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fb6f8097200 0x7fb6f8124690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33256/0 (socket says 172.21.15.51:33256) 2021-02-06T22:57:35.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.063+0000 7fb6f77fe700 1 -- 172.21.15.51:0/1051174765 learned_addr learned my addr 172.21.15.51:0/1051174765 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6f77fe700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.51:6790/0 conn(0x7fb6f8097200 legacy=0x7fb6f8124690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6fcc95700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.51:6789/0 conn(0x7fb6f80976b0 legacy=0x7fb6f8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.070 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter ms_handle_connect 0x7fb6f8097200 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter ms_handle_connect 0x7fb6f80976b0 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter ms_handle_connect 0x7fb6f8093e80 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.071 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6f7fff700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.106:6789/0 conn(0x7fb6f8093e80 legacy=0x7fb6f8139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648563257 0 0) 0x7fb6f8122fb0 con 0x7fb6f8097200 2021-02-06T22:57:35.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d8004bd0 con 0x7fb6f8097200 2021-02-06T22:57:35.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762194528 0 0) 0x7fb6f80995a0 con 0x7fb6f80976b0 2021-02-06T22:57:35.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f8122fb0 con 0x7fb6f80976b0 2021-02-06T22:57:35.072 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690154736 0 0) 0x7fb6f8122d10 con 0x7fb6f8093e80 2021-02-06T22:57:35.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f80995a0 con 0x7fb6f8093e80 2021-02-06T22:57:35.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 538706465 0 0) 0x7fb6d8004bd0 con 0x7fb6f8097200 2021-02-06T22:57:35.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6f8122d10 con 0x7fb6f8097200 2021-02-06T22:57:35.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6e8001680 con 0x7fb6f8097200 2021-02-06T22:57:35.073 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2503810963 0 0) 0x7fb6f8122fb0 con 0x7fb6f80976b0 2021-02-06T22:57:35.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6d8004bd0 con 0x7fb6f80976b0 2021-02-06T22:57:35.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6f0001fd0 con 0x7fb6f80976b0 2021-02-06T22:57:35.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 154792195 0 0) 0x7fb6f80995a0 con 0x7fb6f8093e80 2021-02-06T22:57:35.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.065+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb6f8122fb0 con 0x7fb6f8093e80 2021-02-06T22:57:35.074 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 29548287 0 0) 0x7fb6f8122d10 con 0x7fb6f8097200 2021-02-06T22:57:35.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.106:6789/0 conn(0x7fb6f8093e80 legacy=0x7fb6f8139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.51:6789/0 conn(0x7fb6f80976b0 legacy=0x7fb6f8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f813a450 con 0x7fb6f8097200 2021-02-06T22:57:35.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f8124da0 con 0x7fb6f8097200 2021-02-06T22:57:35.075 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6fe6f8700 10 client.4889.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:35.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f81437b0 con 0x7fb6f8097200 2021-02-06T22:57:35.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6fe6f8700 1 librados: init done 2021-02-06T22:57:35.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fb6e8001490 con 0x7fb6f8097200 2021-02-06T22:57:35.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fb6e8004ea0 con 0x7fb6f8097200 2021-02-06T22:57:35.076 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.066+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fb6e800d660 con 0x7fb6f8097200 2021-02-06T22:57:35.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fb6e8039590 con 0x7fb6f8097200 2021-02-06T22:57:35.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6dffff700 10 client.4889.objecter ms_dispatch 0x7fb6f8001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:35.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6dffff700 3 client.4889.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:35.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6dffff700 3 client.4889.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:35.077 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6dffff700 20 client.4889.objecter dump_active .. 0 homeless 2021-02-06T22:57:35.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.067+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d0004d60 con 0x7fb6f8097200 2021-02-06T22:57:35.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.069+0000 7fb6dffff700 10 client.4889.objecter ms_handle_connect 0x7fb6d80306d0 2021-02-06T22:57:35.078 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.071+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fb6e8012540 con 0x7fb6f8097200 2021-02-06T22:57:35.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.256+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6d0000b50 con 0x7fb6d80306d0 2021-02-06T22:57:35.255 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.256+0000 7fb6dffff700 1 -- 172.21.15.51:0/1051174765 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (unknown 3782719169 0 0) 0x7fb6d0000b50 con 0x7fb6d80306d0 2021-02-06T22:57:35.257 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 10 librados: watch_flush enter 2021-02-06T22:57:35.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 10 librados: watch_flush exit 2021-02-06T22:57:35.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 20 client.4889.objecter shutdown clearing up homeless session... 2021-02-06T22:57:35.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 10 client.4889.objecter successfully canceled tick 2021-02-06T22:57:35.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.106:6812/33219 conn(0x7fb6d80306d0 legacy=0x7fb6d8032b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.258 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 >> v1:172.21.15.51:6790/0 conn(0x7fb6f8097200 legacy=0x7fb6f8124690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 shutdown_connections 2021-02-06T22:57:35.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 >> 172.21.15.51:0/1051174765 conn(0x7fb6f809ae00 msgr2=0x7fb6f80951e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 shutdown_connections 2021-02-06T22:57:35.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 -- 172.21.15.51:0/1051174765 wait complete. 2021-02-06T22:57:35.259 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.258+0000 7fb6fe6f8700 1 librados: shutdown 2021-02-06T22:57:35.260 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 4 to deep-scrub 2021-02-06T22:57:35.268 INFO:tasks.ceph:Scrubbing osd.5 2021-02-06T22:57:35.269 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2021-02-06T22:57:35.394 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.395+0000 7f5bb5505700 1 Processor -- start 2021-02-06T22:57:35.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.395+0000 7f5bb5505700 1 -- start start 2021-02-06T22:57:35.395 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5bb5505700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb008fc30 con 0x7f5bb0092420 2021-02-06T22:57:35.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5bb5505700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0091b20 con 0x7f5bb0093490 2021-02-06T22:57:35.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5bb5505700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0091dc0 con 0x7f5bb0094d50 2021-02-06T22:57:35.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5baeffd700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 0x7f5bb008ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33264/0 (socket says 172.21.15.51:33264) 2021-02-06T22:57:35.396 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5baf7fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f5bb0092420 0x7f5bb012fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32922/0 (socket says 172.21.15.51:32922) 2021-02-06T22:57:35.397 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.396+0000 7f5baeffd700 1 -- 172.21.15.51:0/4217844261 learned_addr learned my addr 172.21.15.51:0/4217844261 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.399 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5baf7fe700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.51:6789/0 conn(0x7f5bb0092420 legacy=0x7f5bb012fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5baeffd700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 legacy=0x7f5bb008ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5bae7fc700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.106:6789/0 conn(0x7f5bb0093490 legacy=0x7f5bb008f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269470367 0 0) 0x7f5bb0091dc0 con 0x7f5bb0094d50 2021-02-06T22:57:35.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b9c003230 con 0x7f5bb0094d50 2021-02-06T22:57:35.400 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960391871 0 0) 0x7f5bb008fc30 con 0x7f5bb0092420 2021-02-06T22:57:35.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0091dc0 con 0x7f5bb0092420 2021-02-06T22:57:35.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260133551 0 0) 0x7f5bb0091b20 con 0x7f5bb0093490 2021-02-06T22:57:35.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.398+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb008fc30 con 0x7f5bb0093490 2021-02-06T22:57:35.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2286769257 0 0) 0x7f5b9c003230 con 0x7f5bb0094d50 2021-02-06T22:57:35.401 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.106:6789/0 conn(0x7f5bb0093490 legacy=0x7f5bb008f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.51:6789/0 conn(0x7f5bb0092420 legacy=0x7f5bb012fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0092060 con 0x7f5bb0094d50 2021-02-06T22:57:35.402 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba0001930 con 0x7f5bb0094d50 2021-02-06T22:57:35.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5ba0001c40 con 0x7f5bb0094d50 2021-02-06T22:57:35.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5badffb700 1 -- 172.21.15.51:0/4217844261 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba0004750 con 0x7f5bb0094d50 2021-02-06T22:57:35.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5bb5505700 1 -- 172.21.15.51:0/4217844261 >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 legacy=0x7f5bb008ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.403 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5bb5505700 1 -- 172.21.15.51:0/4217844261 shutdown_connections 2021-02-06T22:57:35.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5bb5505700 1 -- 172.21.15.51:0/4217844261 >> 172.21.15.51:0/4217844261 conn(0x7f5bb0099460 msgr2=0x7f5bb0099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5bb5505700 1 -- 172.21.15.51:0/4217844261 shutdown_connections 2021-02-06T22:57:35.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.399+0000 7f5bb5505700 1 -- 172.21.15.51:0/4217844261 wait complete. 2021-02-06T22:57:35.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 librados: starting msgr at 2021-02-06T22:57:35.404 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 librados: starting objecter 2021-02-06T22:57:35.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 Processor -- start 2021-02-06T22:57:35.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 -- start start 2021-02-06T22:57:35.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 librados: setting wanted keys 2021-02-06T22:57:35.405 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.400+0000 7f5bb5505700 1 librados: calling monclient init 2021-02-06T22:57:35.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5bb5505700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0130e00 con 0x7f5bb0093490 2021-02-06T22:57:35.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5bb5505700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0138440 con 0x7f5bb0092420 2021-02-06T22:57:35.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5bb5505700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0094570 con 0x7f5bb0094d50 2021-02-06T22:57:35.410 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5baf7fe700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 0x7f5bb0140020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33274/0 (socket says 172.21.15.51:33274) 2021-02-06T22:57:35.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5baf7fe700 1 -- 172.21.15.51:0/3295444353 learned_addr learned my addr 172.21.15.51:0/3295444353 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.401+0000 7f5bae7fc700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f5bb0093490 0x7f5bb013c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32930/0 (socket says 172.21.15.51:32930) 2021-02-06T22:57:35.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5baf7fe700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 legacy=0x7f5bb0140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5bae7fc700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.51:6789/0 conn(0x7f5bb0093490 legacy=0x7f5bb013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.411 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter ms_handle_connect 0x7f5bb0094d50 2021-02-06T22:57:35.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter ms_handle_connect 0x7f5bb0093490 2021-02-06T22:57:35.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.412 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter ms_handle_connect 0x7f5bb0092420 2021-02-06T22:57:35.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5baeffd700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.106:6789/0 conn(0x7f5bb0092420 legacy=0x7f5bb0137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670039713 0 0) 0x7f5bb0094570 con 0x7f5bb0094d50 2021-02-06T22:57:35.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b90004bd0 con 0x7f5bb0094d50 2021-02-06T22:57:35.413 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454342505 0 0) 0x7f5bb0130e00 con 0x7f5bb0093490 2021-02-06T22:57:35.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0094570 con 0x7f5bb0093490 2021-02-06T22:57:35.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616610913 0 0) 0x7f5bb0138440 con 0x7f5bb0092420 2021-02-06T22:57:35.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0130e00 con 0x7f5bb0092420 2021-02-06T22:57:35.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3807229356 0 0) 0x7f5b90004bd0 con 0x7f5bb0094d50 2021-02-06T22:57:35.414 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5bb0138440 con 0x7f5bb0094d50 2021-02-06T22:57:35.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.403+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba8001d10 con 0x7f5bb0094d50 2021-02-06T22:57:35.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 387590514 0 0) 0x7f5bb0094570 con 0x7f5bb0093490 2021-02-06T22:57:35.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5b90004bd0 con 0x7f5bb0093490 2021-02-06T22:57:35.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba4001c20 con 0x7f5bb0093490 2021-02-06T22:57:35.415 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3284587258 0 0) 0x7f5bb0130e00 con 0x7f5bb0092420 2021-02-06T22:57:35.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5bb0094570 con 0x7f5bb0092420 2021-02-06T22:57:35.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba00018f0 con 0x7f5bb0092420 2021-02-06T22:57:35.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2692996621 0 0) 0x7f5bb0138440 con 0x7f5bb0094d50 2021-02-06T22:57:35.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.106:6789/0 conn(0x7f5bb0092420 legacy=0x7f5bb0137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.416 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.51:6789/0 conn(0x7f5bb0093490 legacy=0x7f5bb013c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0131a70 con 0x7f5bb0094d50 2021-02-06T22:57:35.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0093e00 con 0x7f5bb0094d50 2021-02-06T22:57:35.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 10 client.4895.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:35.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb012fb50 con 0x7f5bb0094d50 2021-02-06T22:57:35.417 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 1 librados: init done 2021-02-06T22:57:35.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f5ba8004c20 con 0x7f5bb0094d50 2021-02-06T22:57:35.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f5ba8004f30 con 0x7f5bb0094d50 2021-02-06T22:57:35.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f5ba8005110 con 0x7f5bb0094d50 2021-02-06T22:57:35.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 10 client.4895.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2021-02-06T22:57:35.418 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 15 client.4895.objecter _session_command_op_assign -1 1 2021-02-06T22:57:35.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 20 client.4895.objecter _get_session osd=-1 returning homeless 2021-02-06T22:57:35.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.404+0000 7f5bb5505700 10 client.4895.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:35.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.51:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b88002870 con 0x7f5bb0094d50 2021-02-06T22:57:35.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f5ba8039890 con 0x7f5bb0094d50 2021-02-06T22:57:35.419 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 10 client.4895.objecter ms_dispatch 0x7f5bb0001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:35.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 3 client.4895.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:35.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 3 client.4895.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:35.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 10 client.4895.objecter checking command 1 2021-02-06T22:57:35.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter _get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.420 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 15 client.4895.objecter _session_command_op_remove -1 1 2021-02-06T22:57:35.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter _get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 15 client.4895.objecter _session_command_op_assign 5 1 2021-02-06T22:57:35.421 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 4 2021-02-06T22:57:35.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 10 client.4895.objecter _send_command 1 2021-02-06T22:57:35.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.106:6805/33665 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b9003ae20 con 0x7f5b90037190 2021-02-06T22:57:35.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 20 client.4895.objecter dump_active .. 0 homeless 2021-02-06T22:57:35.422 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.405+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (unknown 2942983318 0 0) 0x7f5ba80124f0 con 0x7f5bb0094d50 2021-02-06T22:57:35.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.407+0000 7f5b96ffd700 10 client.4895.objecter ms_handle_connect 0x7f5b90030750 2021-02-06T22:57:35.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.410+0000 7f5b96ffd700 10 client.4895.objecter ms_handle_connect 0x7f5b90037190 2021-02-06T22:57:35.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.411+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== osd.5 v1:172.21.15.106:6805/33665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (unknown 0 0 163244622) 0x7f5b9003ae20 con 0x7f5b90037190 2021-02-06T22:57:35.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.411+0000 7f5b96ffd700 10 client.4895.objecter ms_dispatch 0x7f5bb0001510 command_reply(tid 1: 0 ) v1 2021-02-06T22:57:35.423 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.411+0000 7f5b96ffd700 10 client.4895.objecter _finish_command 1 = system:0 2021-02-06T22:57:35.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.411+0000 7f5b96ffd700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 4 2021-02-06T22:57:35.424 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.411+0000 7f5b96ffd700 15 client.4895.objecter _session_command_op_remove 5 1 2021-02-06T22:57:35.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 10 client.4895.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2021-02-06T22:57:35.425 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 15 client.4895.objecter _session_command_op_assign -1 2 2021-02-06T22:57:35.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 20 client.4895.objecter _get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 20 client.4895.objecter _get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.426 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 15 client.4895.objecter _session_command_op_remove -1 2 2021-02-06T22:57:35.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 20 client.4895.objecter get_session s=0x7f5b90036ae0 osd=5 3 2021-02-06T22:57:35.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 15 client.4895.objecter _session_command_op_assign 5 2 2021-02-06T22:57:35.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 4 2021-02-06T22:57:35.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 10 client.4895.objecter _send_command 2 2021-02-06T22:57:35.427 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.426+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 --> v1:172.21.15.106:6805/33665 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5b88001160 con 0x7f5b90037190 2021-02-06T22:57:35.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5b96ffd700 1 -- 172.21.15.51:0/3295444353 <== osd.5 v1:172.21.15.106:6805/33665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (unknown 0 0 1509541053) 0x7f5b88001160 con 0x7f5b90037190 2021-02-06T22:57:35.429 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5b96ffd700 10 client.4895.objecter ms_dispatch 0x7f5bb0001510 command_reply(tid 2: 0 ) v1 2021-02-06T22:57:35.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5b96ffd700 10 client.4895.objecter _finish_command 2 = system:0 2021-02-06T22:57:35.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5b96ffd700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 4 2021-02-06T22:57:35.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5b96ffd700 15 client.4895.objecter _session_command_op_remove 5 2 2021-02-06T22:57:35.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 10 librados: watch_flush enter 2021-02-06T22:57:35.430 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 10 librados: watch_flush exit 2021-02-06T22:57:35.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 10 client.4895.objecter close_session for osd.5 2021-02-06T22:57:35.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.106:6805/33665 conn(0x7f5b90037190 legacy=0x7f5b900395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 20 client.4895.objecter put_session s=0x7f5b90036ae0 osd=5 1 2021-02-06T22:57:35.431 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 20 client.4895.objecter shutdown clearing up homeless session... 2021-02-06T22:57:35.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 10 client.4895.objecter successfully canceled tick 2021-02-06T22:57:35.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.106:6812/33219 conn(0x7f5b90030750 legacy=0x7f5b90032c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 >> v1:172.21.15.51:6790/0 conn(0x7f5bb0094d50 legacy=0x7f5bb0140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5baf7fe700 1 -- 172.21.15.51:0/3295444353 reap_dead start 2021-02-06T22:57:35.432 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 shutdown_connections 2021-02-06T22:57:35.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 >> 172.21.15.51:0/3295444353 conn(0x7f5bb0099460 msgr2=0x7f5bb0129fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 shutdown_connections 2021-02-06T22:57:35.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 -- 172.21.15.51:0/3295444353 wait complete. 2021-02-06T22:57:35.433 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.427+0000 7f5bb5505700 1 librados: shutdown 2021-02-06T22:57:35.433 INFO:teuthology.orchestra.run.smithi051.stdout:{ 2021-02-06T22:57:35.434 INFO:teuthology.orchestra.run.smithi051.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2021-02-06T22:57:35.434 INFO:teuthology.orchestra.run.smithi051.stdout:} 2021-02-06T22:57:35.437 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2021-02-06T22:57:35.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe2ac2700 1 Processor -- start 2021-02-06T22:57:35.561 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe2ac2700 1 -- start start 2021-02-06T22:57:35.562 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc095440 con 0x7f0fdc092bf0 2021-02-06T22:57:35.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0907b0 con 0x7f0fdc08fa70 2021-02-06T22:57:35.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc091010 con 0x7f0fdc12ce00 2021-02-06T22:57:35.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe105f700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f0fdc12ce00 0x7f0fdc12f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33284/0 (socket says 172.21.15.51:33284) 2021-02-06T22:57:35.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fe105f700 1 -- 172.21.15.51:0/2948140937 learned_addr learned my addr 172.21.15.51:0/2948140937 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.563 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.562+0000 7f0fdbfff700 1 --1- 172.21.15.51:0/2948140937 >> v1:172.21.15.51:6789/0 conn(0x7f0fdc092bf0 0x7f0fdc0930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32938/0 (socket says 172.21.15.51:32938) 2021-02-06T22:57:35.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.564+0000 7f0fe105f700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.51:6790/0 conn(0x7f0fdc12ce00 legacy=0x7f0fdc12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.564+0000 7f0fdbfff700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.51:6789/0 conn(0x7f0fdc092bf0 legacy=0x7f0fdc0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fe085e700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.106:6789/0 conn(0x7f0fdc08fa70 legacy=0x7f0fdc0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.566 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393637078 0 0) 0x7f0fdc095440 con 0x7f0fdc092bf0 2021-02-06T22:57:35.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0003230 con 0x7f0fdc092bf0 2021-02-06T22:57:35.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206516576 0 0) 0x7f0fdc091010 con 0x7f0fdc12ce00 2021-02-06T22:57:35.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc095440 con 0x7f0fdc12ce00 2021-02-06T22:57:35.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3969290325 0 0) 0x7f0fc0003230 con 0x7f0fdc092bf0 2021-02-06T22:57:35.567 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.51:6790/0 conn(0x7f0fdc12ce00 legacy=0x7f0fdc12f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.106:6789/0 conn(0x7f0fdc08fa70 legacy=0x7f0fdc0921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0912b0 con 0x7f0fdc092bf0 2021-02-06T22:57:35.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fc8001930 con 0x7f0fdc092bf0 2021-02-06T22:57:35.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.0 v1:172.21.15.51:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0fc8001c40 con 0x7f0fdc092bf0 2021-02-06T22:57:35.568 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.565+0000 7f0fdb7fe700 1 -- 172.21.15.51:0/2948140937 <== mon.0 v1:172.21.15.51:6789/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fc8004690 con 0x7f0fdc092bf0 2021-02-06T22:57:35.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/2948140937 >> v1:172.21.15.51:6789/0 conn(0x7f0fdc092bf0 legacy=0x7f0fdc0930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/2948140937 shutdown_connections 2021-02-06T22:57:35.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/2948140937 >> 172.21.15.51:0/2948140937 conn(0x7f0fdc096860 msgr2=0x7f0fdc099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/2948140937 shutdown_connections 2021-02-06T22:57:35.569 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/2948140937 wait complete. 2021-02-06T22:57:35.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 librados: starting msgr at 2021-02-06T22:57:35.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 librados: starting objecter 2021-02-06T22:57:35.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.566+0000 7f0fe2ac2700 1 Processor -- start 2021-02-06T22:57:35.570 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 -- start start 2021-02-06T22:57:35.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 librados: setting wanted keys 2021-02-06T22:57:35.571 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 librados: calling monclient init 2021-02-06T22:57:35.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc13a500 con 0x7f0fdc08fa70 2021-02-06T22:57:35.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc12b810 con 0x7f0fdc092bf0 2021-02-06T22:57:35.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe2ac2700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc12bab0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe085e700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f0fdc08fa70 0x7f0fdc1396e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32944/0 (socket says 172.21.15.51:32944) 2021-02-06T22:57:35.574 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.567+0000 7f0fe085e700 1 -- 172.21.15.51:0/1193637701 learned_addr learned my addr 172.21.15.51:0/1193637701 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fe085e700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.51:6789/0 conn(0x7f0fdc08fa70 legacy=0x7f0fdc1396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 10 client.?.objecter ms_handle_connect 0x7f0fdc08fa70 2021-02-06T22:57:35.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fe105f700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.51:6790/0 conn(0x7f0fdc12ce00 legacy=0x7f0fdc141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.575 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 10 client.?.objecter ms_handle_connect 0x7f0fdc12ce00 2021-02-06T22:57:35.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033312790 0 0) 0x7f0fdc13a500 con 0x7f0fdc08fa70 2021-02-06T22:57:35.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.569+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fbc004bd0 con 0x7f0fdc08fa70 2021-02-06T22:57:35.576 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 10 client.?.objecter ms_handle_connect 0x7f0fdc092bf0 2021-02-06T22:57:35.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fdbfff700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.106:6789/0 conn(0x7f0fdc092bf0 legacy=0x7f0fdc139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388656754 0 0) 0x7f0fdc12bab0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc13a500 con 0x7f0fdc12ce00 2021-02-06T22:57:35.577 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695644027 0 0) 0x7f0fdc12b810 con 0x7f0fdc092bf0 2021-02-06T22:57:35.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc12bab0 con 0x7f0fdc092bf0 2021-02-06T22:57:35.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1841138894 0 0) 0x7f0fdc13a500 con 0x7f0fdc12ce00 2021-02-06T22:57:35.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fdc12b810 con 0x7f0fdc12ce00 2021-02-06T22:57:35.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1802897583 0 0) 0x7f0fbc004bd0 con 0x7f0fdc08fa70 2021-02-06T22:57:35.578 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0fdc13a500 con 0x7f0fdc08fa70 2021-02-06T22:57:35.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fd4001fe0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fd0001c90 con 0x7f0fdc08fa70 2021-02-06T22:57:35.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 556923953 0 0) 0x7f0fdc12b810 con 0x7f0fdc12ce00 2021-02-06T22:57:35.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.106:6789/0 conn(0x7f0fdc092bf0 legacy=0x7f0fdc139df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.51:6789/0 conn(0x7f0fdc08fa70 legacy=0x7f0fdc1396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc12bd50 con 0x7f0fdc12ce00 2021-02-06T22:57:35.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc12b1f0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fe2ac2700 10 client.4901.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:35.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc12c3b0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f0fd4004ba0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fe2ac2700 1 librados: init done 2021-02-06T22:57:35.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.570+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f0fd4004eb0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f0fd400d6f0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.581 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f0fd40396c0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 10 client.4901.objecter ms_dispatch 0x7f0fdc001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 3 client.4901.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 3 client.4901.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fd8ff9700 20 client.4901.objecter dump_active .. 0 homeless 2021-02-06T22:57:35.582 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.571+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0581b0 con 0x7f0fdc12ce00 2021-02-06T22:57:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.573+0000 7f0fd8ff9700 10 client.4901.objecter ms_handle_connect 0x7f0fbc030540 2021-02-06T22:57:35.583 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.575+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f0fd4012560 con 0x7f0fdc12ce00 2021-02-06T22:57:35.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.759+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fdc0615b0 con 0x7f0fbc030540 2021-02-06T22:57:35.758 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.759+0000 7f0fd8ff9700 1 -- 172.21.15.51:0/1193637701 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (unknown 2264484800 0 0) 0x7f0fdc0615b0 con 0x7f0fbc030540 2021-02-06T22:57:35.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 10 librados: watch_flush enter 2021-02-06T22:57:35.760 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 10 librados: watch_flush exit 2021-02-06T22:57:35.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 20 client.4901.objecter shutdown clearing up homeless session... 2021-02-06T22:57:35.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 10 client.4901.objecter successfully canceled tick 2021-02-06T22:57:35.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.106:6812/33219 conn(0x7f0fbc030540 legacy=0x7f0fbc032a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.761 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 >> v1:172.21.15.51:6790/0 conn(0x7f0fdc12ce00 legacy=0x7f0fdc141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 shutdown_connections 2021-02-06T22:57:35.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 >> 172.21.15.51:0/1193637701 conn(0x7f0fdc096860 msgr2=0x7f0fdc122d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 shutdown_connections 2021-02-06T22:57:35.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 -- 172.21.15.51:0/1193637701 wait complete. 2021-02-06T22:57:35.762 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.761+0000 7f0fe2ac2700 1 librados: shutdown 2021-02-06T22:57:35.763 INFO:teuthology.orchestra.run.smithi051.stderr:instructed osd(s) 5 to deep-scrub 2021-02-06T22:57:35.772 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-06T22:57:35.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9daf9700 1 Processor -- start 2021-02-06T22:57:35.893 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9daf9700 1 -- start start 2021-02-06T22:57:35.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9daf9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98061bb0 con 0x7fad98097560 2021-02-06T22:57:35.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9daf9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9808f0f0 con 0x7fad98090f50 2021-02-06T22:57:35.894 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9daf9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9808f390 con 0x7fad98127640 2021-02-06T22:57:35.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9d2f8700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 0x7fad981330b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33298/0 (socket says 172.21.15.51:33298) 2021-02-06T22:57:35.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9caf7700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 0x7fad98090840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32952/0 (socket says 172.21.15.51:32952) 2021-02-06T22:57:35.895 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.894+0000 7fad9d2f8700 1 -- 172.21.15.51:0/3570318894 learned_addr learned my addr 172.21.15.51:0/3570318894 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.896+0000 7fad9caf7700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 legacy=0x7fad98090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad9d2f8700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 legacy=0x7fad981330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.897 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad97fff700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.106:6789/0 conn(0x7fad98090f50 legacy=0x7fad9812f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889450017 0 0) 0x7fad98061bb0 con 0x7fad98097560 2021-02-06T22:57:35.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c003230 con 0x7fad98097560 2021-02-06T22:57:35.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258145916 0 0) 0x7fad9808f390 con 0x7fad98127640 2021-02-06T22:57:35.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad98061bb0 con 0x7fad98127640 2021-02-06T22:57:35.898 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788622416 0 0) 0x7fad9808f0f0 con 0x7fad98090f50 2021-02-06T22:57:35.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad9808f390 con 0x7fad98090f50 2021-02-06T22:57:35.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2562166363 0 0) 0x7fad98061bb0 con 0x7fad98127640 2021-02-06T22:57:35.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.106:6789/0 conn(0x7fad98090f50 legacy=0x7fad9812f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 legacy=0x7fad98090840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.899 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9808ea60 con 0x7fad98127640 2021-02-06T22:57:35.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fad90001cb0 con 0x7fad98127640 2021-02-06T22:57:35.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad90001fc0 con 0x7fad98127640 2021-02-06T22:57:35.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.897+0000 7fad977fe700 1 -- 172.21.15.51:0/3570318894 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fad90004ad0 con 0x7fad98127640 2021-02-06T22:57:35.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 -- 172.21.15.51:0/3570318894 >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 legacy=0x7fad981330b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.900 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 -- 172.21.15.51:0/3570318894 shutdown_connections 2021-02-06T22:57:35.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 -- 172.21.15.51:0/3570318894 >> 172.21.15.51:0/3570318894 conn(0x7fad9809ac60 msgr2=0x7fad98096c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:35.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 -- 172.21.15.51:0/3570318894 shutdown_connections 2021-02-06T22:57:35.901 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 -- 172.21.15.51:0/3570318894 wait complete. 2021-02-06T22:57:35.904 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 librados: starting msgr at 2021-02-06T22:57:35.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 librados: starting objecter 2021-02-06T22:57:35.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.898+0000 7fad9daf9700 1 Processor -- start 2021-02-06T22:57:35.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 -- start start 2021-02-06T22:57:35.905 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 librados: setting wanted keys 2021-02-06T22:57:35.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 librados: calling monclient init 2021-02-06T22:57:35.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98117e10 con 0x7fad98097560 2021-02-06T22:57:35.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad981180b0 con 0x7fad98090f50 2021-02-06T22:57:35.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9daf9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98118350 con 0x7fad98127640 2021-02-06T22:57:35.906 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad97fff700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 0x7fad981153a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32960/0 (socket says 172.21.15.51:32960) 2021-02-06T22:57:35.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad9d2f8700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 0x7fad981423e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33304/0 (socket says 172.21.15.51:33304) 2021-02-06T22:57:35.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.899+0000 7fad97fff700 1 -- 172.21.15.51:0/4140834115 learned_addr learned my addr 172.21.15.51:0/4140834115 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:35.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad9d2f8700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 legacy=0x7fad981423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.907 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad97fff700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 legacy=0x7fad981153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad94ff9700 10 client.?.objecter ms_handle_connect 0x7fad98127640 2021-02-06T22:57:35.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad94ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad94ff9700 10 client.?.objecter ms_handle_connect 0x7fad98097560 2021-02-06T22:57:35.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.901+0000 7fad94ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.908 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.902+0000 7fad9caf7700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.106:6789/0 conn(0x7fad98090f50 legacy=0x7fad98114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:35.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.902+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 DispatchQueue::entry inject delay of 0.002000 2021-02-06T22:57:35.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 10 client.?.objecter ms_handle_connect 0x7fad98090f50 2021-02-06T22:57:35.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:35.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666556418 0 0) 0x7fad98118350 con 0x7fad98127640 2021-02-06T22:57:35.909 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad78004bd0 con 0x7fad98127640 2021-02-06T22:57:35.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451819918 0 0) 0x7fad981180b0 con 0x7fad98090f50 2021-02-06T22:57:35.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad98118350 con 0x7fad98090f50 2021-02-06T22:57:35.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959458570 0 0) 0x7fad98117e10 con 0x7fad98097560 2021-02-06T22:57:35.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad981180b0 con 0x7fad98097560 2021-02-06T22:57:35.910 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 523803400 0 0) 0x7fad78004bd0 con 0x7fad98127640 2021-02-06T22:57:35.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad98117e10 con 0x7fad98127640 2021-02-06T22:57:35.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fad90001c70 con 0x7fad98127640 2021-02-06T22:57:35.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1650181784 0 0) 0x7fad981180b0 con 0x7fad98097560 2021-02-06T22:57:35.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad78004bd0 con 0x7fad98097560 2021-02-06T22:57:35.911 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fad84001c60 con 0x7fad98097560 2021-02-06T22:57:35.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2995901965 0 0) 0x7fad98117e10 con 0x7fad98127640 2021-02-06T22:57:35.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.106:6789/0 conn(0x7fad98090f50 legacy=0x7fad98114c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.51:6789/0 conn(0x7fad98097560 legacy=0x7fad981153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:35.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98116250 con 0x7fad98127640 2021-02-06T22:57:35.912 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98118710 con 0x7fad98127640 2021-02-06T22:57:35.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad9daf9700 10 client.4907.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:35.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fad98124e70 con 0x7fad98127640 2021-02-06T22:57:35.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad9daf9700 1 librados: init done 2021-02-06T22:57:35.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fad900018e0 con 0x7fad98127640 2021-02-06T22:57:35.913 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.904+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7fad900051e0 con 0x7fad98127640 2021-02-06T22:57:35.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7fad9000d9a0 con 0x7fad98127640 2021-02-06T22:57:35.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.51:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad70004d60 con 0x7fad98127640 2021-02-06T22:57:35.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7fad900398e0 con 0x7fad98127640 2021-02-06T22:57:35.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 10 client.4907.objecter ms_dispatch 0x7fad98001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:35.914 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 3 client.4907.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:35.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 3 client.4907.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:35.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.905+0000 7fad94ff9700 20 client.4907.objecter dump_active .. 0 homeless 2021-02-06T22:57:35.915 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.908+0000 7fad94ff9700 10 client.4907.objecter ms_handle_connect 0x7fad78030720 2021-02-06T22:57:35.916 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:35.909+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mon.2 v1:172.21.15.51:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7fad900125a0 con 0x7fad98127640 2021-02-06T22:57:36.085 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.085+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad70000b50 con 0x7fad78030720 2021-02-06T22:57:36.087 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.088+0000 7fad94ff9700 1 -- 172.21.15.51:0/4140834115 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+45925 (unknown 2965378022 0 1510349914) 0x7fad70000b50 con 0x7fad78030720 2021-02-06T22:57:36.087 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:36.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 10 librados: watch_flush enter 2021-02-06T22:57:36.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 10 librados: watch_flush exit 2021-02-06T22:57:36.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 20 client.4907.objecter shutdown clearing up homeless session... 2021-02-06T22:57:36.089 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 10 client.4907.objecter successfully canceled tick 2021-02-06T22:57:36.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.106:6812/33219 conn(0x7fad78030720 legacy=0x7fad78032be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:36.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.089+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 >> v1:172.21.15.51:6790/0 conn(0x7fad98127640 legacy=0x7fad981423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:36.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.090+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 shutdown_connections 2021-02-06T22:57:36.090 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.090+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 >> 172.21.15.51:0/4140834115 conn(0x7fad9809ac60 msgr2=0x7fad980992e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:36.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.090+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 shutdown_connections 2021-02-06T22:57:36.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.090+0000 7fad9daf9700 1 -- 172.21.15.51:0/4140834115 wait complete. 2021-02-06T22:57:36.091 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:36.090+0000 7fad9daf9700 1 librados: shutdown 2021-02-06T22:57:36.091 INFO:teuthology.orchestra.run.smithi051.stderr:dumped all 2021-02-06T22:57:36.100 INFO:teuthology.orchestra.run.smithi051.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2021-02-06T22:57:34.697957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29360,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":28544,"kb_avail":566201680,"statfs":{"total":579820584960,"available":579790520320,"internally_reserved":0,"allocated":786432,"data_stored":215898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29229056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.219402+0000","last_change":"2021-02-06T22:52:22.218463+0000","last_active":"2021-02-06T22:52:22.219402+0000","last_peered":"2021-02-06T22:52:22.219402+0000","last_clean":"2021-02-06T22:52:22.219402+0000","last_became_active":"2021-02-06T22:52:22.218086+0000","last_became_peered":"2021-02-06T22:52:22.218086+0000","last_unstale":"2021-02-06T22:52:22.219402+0000","last_undegraded":"2021-02-06T22:52:22.219402+0000","last_fullsized":"2021-02-06T22:52:22.219402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220742+0000","last_change":"2021-02-06T22:52:22.219017+0000","last_active":"2021-02-06T22:52:22.220742+0000","last_peered":"2021-02-06T22:52:22.220742+0000","last_clean":"2021-02-06T22:52:22.220742+0000","last_became_active":"2021-02-06T22:52:22.218649+0000","last_became_peered":"2021-02-06T22:52:22.218649+0000","last_unstale":"2021-02-06T22:52:22.220742+0000","last_undegraded":"2021-02-06T22:52:22.220742+0000","last_fullsized":"2021-02-06T22:52:22.220742+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.218366+0000","last_change":"2021-02-06T22:52:22.217659+0000","last_active":"2021-02-06T22:52:22.218366+0000","last_peered":"2021-02-06T22:52:22.218366+0000","last_clean":"2021-02-06T22:52:22.218366+0000","last_became_active":"2021-02-06T22:52:22.217295+0000","last_became_peered":"2021-02-06T22:52:22.217295+0000","last_unstale":"2021-02-06T22:52:22.218366+0000","last_undegraded":"2021-02-06T22:52:22.218366+0000","last_fullsized":"2021-02-06T22:52:22.218366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.438893+0000","last_change":"2021-02-06T22:52:22.438354+0000","last_active":"2021-02-06T22:52:22.438893+0000","last_peered":"2021-02-06T22:52:22.438893+0000","last_clean":"2021-02-06T22:52:22.438893+0000","last_became_active":"2021-02-06T22:52:22.438107+0000","last_became_peered":"2021-02-06T22:52:22.438107+0000","last_unstale":"2021-02-06T22:52:22.438893+0000","last_undegraded":"2021-02-06T22:52:22.438893+0000","last_fullsized":"2021-02-06T22:52:22.438893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221398+0000","last_change":"2021-02-06T22:52:22.220454+0000","last_active":"2021-02-06T22:52:22.221398+0000","last_peered":"2021-02-06T22:52:22.221398+0000","last_clean":"2021-02-06T22:52:22.221398+0000","last_became_active":"2021-02-06T22:52:22.220155+0000","last_became_peered":"2021-02-06T22:52:22.220155+0000","last_unstale":"2021-02-06T22:52:22.221398+0000","last_undegraded":"2021-02-06T22:52:22.221398+0000","last_fullsized":"2021-02-06T22:52:22.221398+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.220681+0000","last_change":"2021-02-06T22:52:22.219481+0000","last_active":"2021-02-06T22:52:22.220681+0000","last_peered":"2021-02-06T22:52:22.220681+0000","last_clean":"2021-02-06T22:52:22.220681+0000","last_became_active":"2021-02-06T22:52:22.218937+0000","last_became_peered":"2021-02-06T22:52:22.218937+0000","last_unstale":"2021-02-06T22:52:22.220681+0000","last_undegraded":"2021-02-06T22:52:22.220681+0000","last_fullsized":"2021-02-06T22:52:22.220681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221493+0000","last_change":"2021-02-06T22:52:22.220288+0000","last_active":"2021-02-06T22:52:22.221493+0000","last_peered":"2021-02-06T22:52:22.221493+0000","last_clean":"2021-02-06T22:52:22.221493+0000","last_became_active":"2021-02-06T22:52:22.219962+0000","last_became_peered":"2021-02-06T22:52:22.219962+0000","last_unstale":"2021-02-06T22:52:22.221493+0000","last_undegraded":"2021-02-06T22:52:22.221493+0000","last_fullsized":"2021-02-06T22:52:22.221493+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"14","state":"active+clean","last_fresh":"2021-02-06T22:52:22.221648+0000","last_change":"2021-02-06T22:52:22.218954+0000","last_active":"2021-02-06T22:52:22.221648+0000","last_peered":"2021-02-06T22:52:22.221648+0000","last_clean":"2021-02-06T22:52:22.221648+0000","last_became_active":"2021-02-06T22:52:22.218477+0000","last_became_peered":"2021-02-06T22:52:22.218477+0000","last_unstale":"2021-02-06T22:52:22.221648+0000","last_undegraded":"2021-02-06T22:52:22.221648+0000","last_fullsized":"2021-02-06T22:52:22.221648+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:52:21.203175+0000","last_clean_scrub_stamp":"2021-02-06T22:52:21.203175+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640321,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86599999999999999,"15min":0.88100000000000001},"min":{"1min":0.63600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.085,"5min":1.292,"15min":1.292},"last":0.73799999999999999}]},{"osd":1,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.78600000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2250000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0960000000000001,"15min":1.1080000000000001},"min":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2729999999999999,"5min":1.395,"15min":1.395},"last":1.0429999999999999}]},{"osd":2,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.89900000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1359999999999999,"5min":1.204,"15min":1.204},"last":1.012},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.95299999999999996,"15min":0.91100000000000003},"min":{"1min":0.77500000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1859999999999999,"5min":1.508,"15min":1.508},"last":0.85299999999999998}]},{"osd":3,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.58699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91400000000000003,"5min":1.204,"15min":1.204},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84799999999999998,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.88200000000000001}]}]},{"osd":4,"up_from":11,"seq":47244640320,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.78200000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.288},"last":1.171}]},{"osd":1,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90400000000000003,"15min":0.93500000000000005},"min":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.206,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1439999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.84199999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.92500000000000004}]},{"osd":2,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94399999999999995},"min":{"1min":0.65900000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.1679999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.73099999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.02}]},{"osd":3,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75900000000000001,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0429999999999999,"5min":1.177,"15min":1.177},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":0.97499999999999998},"min":{"1min":0.70599999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.073,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.94299999999999995}]},{"osd":5,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1020000000000001,"5min":1.423,"15min":1.423},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1719999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.76900000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640321,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.94299999999999995,"15min":0.89800000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0580000000000001,"15min":1.0429999999999999},"min":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0649999999999999,"15min":1.0800000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.96799999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.879,"15min":0.876},"min":{"1min":0.65300000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.123,"5min":1.234,"15min":1.234},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90500000000000003,"15min":0.91700000000000004},"min":{"1min":0.68899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.208,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":1.071}]},{"osd":4,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.58199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90600000000000003,"5min":1.081,"15min":1.081},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.76100000000000001}]},{"osd":5,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84899999999999998,"15min":0.874},"min":{"1min":0.67300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2929999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89100000000000001,"15min":0.91800000000000004},"min":{"1min":0.753,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.165,"5min":1.399,"15min":1.399},"last":0.79900000000000004}]}]},{"osd":2,"up_from":11,"seq":47244640323,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64800000000000002},"min":{"1min":0.47999999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.69999999999999996,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.57699999999999996}]},{"osd":1,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80800000000000005,"15min":0.79200000000000004},"min":{"1min":0.69099999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.407,"15min":1.407},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.65200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0329999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.93300000000000005,"15min":0.93899999999999995},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.206,"5min":1.371,"15min":1.371},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.998,"5min":1.0069999999999999,"15min":1.0009999999999999},"min":{"1min":0.84999999999999998,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.96699999999999997}]},{"osd":4,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3520000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.0800000000000001,"15min":1.03},"min":{"1min":0.83599999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4099999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.155}]},{"osd":5,"last update":"Sat Feb 6 22:56:35 2021","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.119,"15min":1.133},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3140000000000001,"5min":1.756,"15min":1.756},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.119,"15min":1.111},"min":{"1min":0.96199999999999997,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.504,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2250000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640321,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1739999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.78700000000000003}]},{"osd":2,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.62},{"interface":"front","average":{"1min":0.878,"5min":0.88500000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1060000000000001,"5min":1.325,"15min":1.325},"last":0.96399999999999997}]},{"osd":3,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.095},"min":{"1min":0.73499999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1890000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":1.046},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3460000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.073}]},{"osd":4,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.1000000000000001},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":3.073,"15min":3.073},"last":0.878},{"interface":"front","average":{"1min":1.071,"5min":1.052,"15min":1.0960000000000001},"min":{"1min":0.875,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.26,"5min":1.401,"15min":1.401},"last":1.2130000000000001}]},{"osd":5,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0309999999999999,"15min":1.0529999999999999},"min":{"1min":0.80300000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.276,"5min":1.419,"15min":1.419},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.222},"min":{"1min":0.81499999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4610000000000001,"5min":3.149,"15min":3.149},"last":1.2509999999999999}]}]},{"osd":1,"up_from":11,"seq":47244640321,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.65700000000000003,"15min":0.66200000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.133,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.80600000000000005,"15min":0.81200000000000006},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.119,"5min":1.3,"15min":1.3},"last":0.94999999999999996}]},{"osd":2,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67500000000000004,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.157,"15min":1.157},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.83099999999999996},"min":{"1min":0.63900000000000001,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.1180000000000001}]},{"osd":3,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.98799999999999999,"15min":0.97999999999999998},"min":{"1min":0.747,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.27,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.038,"15min":1.034},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.454,"5min":1.488,"15min":1.488},"last":0.79000000000000004}]},{"osd":4,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.999},"min":{"1min":0.74299999999999999,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.161,"5min":1.387,"15min":1.387},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.014,"5min":0.97699999999999998,"15min":0.95299999999999996},"min":{"1min":0.747,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.236,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.179}]},{"osd":5,"last update":"Sat Feb 6 22:56:31 2021","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.028,"15min":1.0169999999999999},"min":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.21,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.115,"5min":1.1499999999999999,"15min":1.1459999999999999},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.381,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0680000000000001}]}]}]}} 2021-02-06T22:57:36.104 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.105 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.105 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.105 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.106 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.106 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.107 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.107 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2021-02-06T22:52:21.203175+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=52, tm_sec=21, tm_wday=5, tm_yday=37, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=6, tm_hour=22, tm_min=57, tm_sec=31, tm_wday=5, tm_yday=37, tm_isdst=0) 2021-02-06T22:57:36.107 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2021-02-06T22:57:56.109 DEBUG:teuthology.orchestra.run.smithi051:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2021-02-06T22:57:56.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29aa9df700 1 Processor -- start 2021-02-06T22:57:56.245 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29aa9df700 1 -- start start 2021-02-06T22:57:56.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29aa9df700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a4095440 con 0x7f29a4092bf0 2021-02-06T22:57:56.246 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29aa9df700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a40907b0 con 0x7f29a408fa70 2021-02-06T22:57:56.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29aa9df700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a4091010 con 0x7f29a412ce00 2021-02-06T22:57:56.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29a8f7c700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f29a412ce00 0x7f29a412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33322/0 (socket says 172.21.15.51:33322) 2021-02-06T22:57:56.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29a37fe700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f29a4092bf0 0x7f29a40930a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32978/0 (socket says 172.21.15.51:32978) 2021-02-06T22:57:56.247 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.246+0000 7f29a8f7c700 1 -- 172.21.15.51:0/1552213232 learned_addr learned my addr 172.21.15.51:0/1552213232 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:56.249 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a37fe700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.51:6789/0 conn(0x7f29a4092bf0 legacy=0x7f29a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a8f7c700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.51:6790/0 conn(0x7f29a412ce00 legacy=0x7f29a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.250 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566697231 0 0) 0x7f29a4091010 con 0x7f29a412ce00 2021-02-06T22:57:56.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2990003230 con 0x7f29a412ce00 2021-02-06T22:57:56.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758204124 0 0) 0x7f29a4095440 con 0x7f29a4092bf0 2021-02-06T22:57:56.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a4091010 con 0x7f29a4092bf0 2021-02-06T22:57:56.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a3fff700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.106:6789/0 conn(0x7f29a408fa70 legacy=0x7f29a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.251 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1828257855 0 0) 0x7f2990003230 con 0x7f29a412ce00 2021-02-06T22:57:56.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.106:6789/0 conn(0x7f29a408fa70 legacy=0x7f29a40921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.51:6789/0 conn(0x7f29a4092bf0 legacy=0x7f29a40930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a40912b0 con 0x7f29a412ce00 2021-02-06T22:57:56.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f299c001ca0 con 0x7f29a412ce00 2021-02-06T22:57:56.252 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f299c001f80 con 0x7f29a412ce00 2021-02-06T22:57:56.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.249+0000 7f29a2ffd700 1 -- 172.21.15.51:0/1552213232 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f299c004ad0 con 0x7f29a412ce00 2021-02-06T22:57:56.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.250+0000 7f29aa9df700 1 -- 172.21.15.51:0/1552213232 >> v1:172.21.15.51:6790/0 conn(0x7f29a412ce00 legacy=0x7f29a412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.250+0000 7f29aa9df700 1 -- 172.21.15.51:0/1552213232 shutdown_connections 2021-02-06T22:57:56.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.250+0000 7f29aa9df700 1 -- 172.21.15.51:0/1552213232 >> 172.21.15.51:0/1552213232 conn(0x7f29a4096860 msgr2=0x7f29a4099290 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:56.253 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.250+0000 7f29aa9df700 1 -- 172.21.15.51:0/1552213232 shutdown_connections 2021-02-06T22:57:56.254 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.250+0000 7f29aa9df700 1 -- 172.21.15.51:0/1552213232 wait complete. 2021-02-06T22:57:56.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 librados: starting msgr at 2021-02-06T22:57:56.261 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 librados: starting objecter 2021-02-06T22:57:56.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 Processor -- start 2021-02-06T22:57:56.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 -- start start 2021-02-06T22:57:56.262 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 librados: setting wanted keys 2021-02-06T22:57:56.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 librados: calling monclient init 2021-02-06T22:57:56.264 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a412e4c0 con 0x7f29a412ce00 2021-02-06T22:57:56.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a412e760 con 0x7f29a408fa70 2021-02-06T22:57:56.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29aa9df700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a412ea00 con 0x7f29a4092bf0 2021-02-06T22:57:56.265 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.251+0000 7f29a8f7c700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f29a412ce00 0x7f29a4137180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32986/0 (socket says 172.21.15.51:32986) 2021-02-06T22:57:56.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.252+0000 7f29a8f7c700 1 -- 172.21.15.51:0/29931408 learned_addr learned my addr 172.21.15.51:0/29931408 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:56.266 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29a8f7c700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.51:6789/0 conn(0x7f29a412ce00 legacy=0x7f29a4137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29a37fe700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.51:6790/0 conn(0x7f29a4092bf0 legacy=0x7f29a4136a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter ms_handle_connect 0x7f29a412ce00 2021-02-06T22:57:56.267 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter ms_handle_connect 0x7f29a4092bf0 2021-02-06T22:57:56.268 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter ms_handle_connect 0x7f29a408fa70 2021-02-06T22:57:56.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.269 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29a3fff700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.106:6789/0 conn(0x7f29a408fa70 legacy=0x7f29a412edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103723627 0 0) 0x7f29a412e4c0 con 0x7f29a412ce00 2021-02-06T22:57:56.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2984004bd0 con 0x7f29a412ce00 2021-02-06T22:57:56.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740366101 0 0) 0x7f29a412ea00 con 0x7f29a4092bf0 2021-02-06T22:57:56.270 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a412e4c0 con 0x7f29a4092bf0 2021-02-06T22:57:56.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921247208 0 0) 0x7f29a412e760 con 0x7f29a408fa70 2021-02-06T22:57:56.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a412ea00 con 0x7f29a408fa70 2021-02-06T22:57:56.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1130322425 0 0) 0x7f2984004bd0 con 0x7f29a412ce00 2021-02-06T22:57:56.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29a412e760 con 0x7f29a412ce00 2021-02-06T22:57:56.271 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f299c001c60 con 0x7f29a412ce00 2021-02-06T22:57:56.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3066307573 0 0) 0x7f29a412e4c0 con 0x7f29a4092bf0 2021-02-06T22:57:56.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2984004bd0 con 0x7f29a4092bf0 2021-02-06T22:57:56.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2994001c60 con 0x7f29a4092bf0 2021-02-06T22:57:56.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1750623040 0 0) 0x7f29a412ea00 con 0x7f29a408fa70 2021-02-06T22:57:56.272 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29a412e4c0 con 0x7f29a408fa70 2021-02-06T22:57:56.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f2998001b30 con 0x7f29a408fa70 2021-02-06T22:57:56.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1821902122 0 0) 0x7f29a412e760 con 0x7f29a412ce00 2021-02-06T22:57:56.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.51:6790/0 conn(0x7f29a4092bf0 legacy=0x7f29a4136a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.273 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.106:6789/0 conn(0x7f29a408fa70 legacy=0x7f29a412edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a412c3a0 con 0x7f29a412ce00 2021-02-06T22:57:56.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a412d530 con 0x7f29a412ce00 2021-02-06T22:57:56.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29aa9df700 10 client.4941.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:56.274 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a413fea0 con 0x7f29a412ce00 2021-02-06T22:57:56.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.254+0000 7f29aa9df700 1 librados: init done 2021-02-06T22:57:56.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f299c001810 con 0x7f29a412ce00 2021-02-06T22:57:56.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f299c0053f0 con 0x7f29a412ce00 2021-02-06T22:57:56.275 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f299c00dbb0 con 0x7f29a412ce00 2021-02-06T22:57:56.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f299c039970 con 0x7f29a412ce00 2021-02-06T22:57:56.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 10 client.4941.objecter ms_dispatch 0x7f29a4001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:56.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 3 client.4941.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:56.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 3 client.4941.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:56.276 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f297c004d60 con 0x7f29a412ce00 2021-02-06T22:57:56.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.255+0000 7f298bfff700 20 client.4941.objecter dump_active .. 0 homeless 2021-02-06T22:57:56.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.258+0000 7f298bfff700 10 client.4941.objecter ms_handle_connect 0x7f2984030770 2021-02-06T22:57:56.277 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.259+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f299c012920 con 0x7f29a412ce00 2021-02-06T22:57:56.435 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.436+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 --> v1:172.21.15.106:6812/33219 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f297c000b50 con 0x7f2984030770 2021-02-06T22:57:56.438 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.438+0000 7f298bfff700 1 -- 172.21.15.51:0/29931408 <== mgr.4104 v1:172.21.15.106:6812/33219 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+45902 (unknown 2965378022 0 3034726442) 0x7f297c000b50 con 0x7f2984030770 2021-02-06T22:57:56.438 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-06T22:57:56.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 10 librados: watch_flush enter 2021-02-06T22:57:56.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 10 librados: watch_flush exit 2021-02-06T22:57:56.440 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 20 client.4941.objecter shutdown clearing up homeless session... 2021-02-06T22:57:56.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 10 client.4941.objecter successfully canceled tick 2021-02-06T22:57:56.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.106:6812/33219 conn(0x7f2984030770 legacy=0x7f2984032c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 >> v1:172.21.15.51:6789/0 conn(0x7f29a412ce00 legacy=0x7f29a4137180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.441 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 shutdown_connections 2021-02-06T22:57:56.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 >> 172.21.15.51:0/29931408 conn(0x7f29a4096860 msgr2=0x7f29a4093bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:56.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 shutdown_connections 2021-02-06T22:57:56.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 -- 172.21.15.51:0/29931408 wait complete. 2021-02-06T22:57:56.442 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.440+0000 7f29aa9df700 1 librados: shutdown 2021-02-06T22:57:56.442 INFO:teuthology.orchestra.run.smithi051.stderr:dumped all 2021-02-06T22:57:56.450 INFO:teuthology.orchestra.run.smithi051.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2021-02-06T22:57:54.701725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":29424,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":28608,"kb_avail":566201616,"statfs":{"total":579820584960,"available":579790454784,"internally_reserved":0,"allocated":786432,"data_stored":215898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29294592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:44.493378+0000","last_change":"2021-02-06T22:57:44.493378+0000","last_active":"2021-02-06T22:57:44.493378+0000","last_peered":"2021-02-06T22:57:44.493378+0000","last_clean":"2021-02-06T22:57:44.493378+0000","last_became_active":"2021-02-06T22:52:22.218086+0000","last_became_peered":"2021-02-06T22:52:22.218086+0000","last_unstale":"2021-02-06T22:57:44.493378+0000","last_undegraded":"2021-02-06T22:57:44.493378+0000","last_fullsized":"2021-02-06T22:57:44.493378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:44.493251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:44.493251+0000","last_clean_scrub_stamp":"2021-02-06T22:57:44.493251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:40.523589+0000","last_change":"2021-02-06T22:57:40.523589+0000","last_active":"2021-02-06T22:57:40.523589+0000","last_peered":"2021-02-06T22:57:40.523589+0000","last_clean":"2021-02-06T22:57:40.523589+0000","last_became_active":"2021-02-06T22:52:22.218649+0000","last_became_peered":"2021-02-06T22:52:22.218649+0000","last_unstale":"2021-02-06T22:57:40.523589+0000","last_undegraded":"2021-02-06T22:57:40.523589+0000","last_fullsized":"2021-02-06T22:57:40.523589+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:40.523480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:40.523480+0000","last_clean_scrub_stamp":"2021-02-06T22:57:40.523480+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:34.665594+0000","last_change":"2021-02-06T22:57:34.665594+0000","last_active":"2021-02-06T22:57:34.665594+0000","last_peered":"2021-02-06T22:57:34.665594+0000","last_clean":"2021-02-06T22:57:34.665594+0000","last_became_active":"2021-02-06T22:52:22.217295+0000","last_became_peered":"2021-02-06T22:52:22.217295+0000","last_unstale":"2021-02-06T22:57:34.665594+0000","last_undegraded":"2021-02-06T22:57:34.665594+0000","last_fullsized":"2021-02-06T22:57:34.665594+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:34.665471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:34.665471+0000","last_clean_scrub_stamp":"2021-02-06T22:57:34.665471+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:37.559269+0000","last_change":"2021-02-06T22:57:37.559269+0000","last_active":"2021-02-06T22:57:37.559269+0000","last_peered":"2021-02-06T22:57:37.559269+0000","last_clean":"2021-02-06T22:57:37.559269+0000","last_became_active":"2021-02-06T22:52:22.438107+0000","last_became_peered":"2021-02-06T22:52:22.438107+0000","last_unstale":"2021-02-06T22:57:37.559269+0000","last_undegraded":"2021-02-06T22:57:37.559269+0000","last_fullsized":"2021-02-06T22:57:37.559269+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:37.559168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:37.559168+0000","last_clean_scrub_stamp":"2021-02-06T22:57:37.559168+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:35.050255+0000","last_change":"2021-02-06T22:57:35.050255+0000","last_active":"2021-02-06T22:57:35.050255+0000","last_peered":"2021-02-06T22:57:35.050255+0000","last_clean":"2021-02-06T22:57:35.050255+0000","last_became_active":"2021-02-06T22:52:22.220155+0000","last_became_peered":"2021-02-06T22:52:22.220155+0000","last_unstale":"2021-02-06T22:57:35.050255+0000","last_undegraded":"2021-02-06T22:57:35.050255+0000","last_fullsized":"2021-02-06T22:57:35.050255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:35.050173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:35.050173+0000","last_clean_scrub_stamp":"2021-02-06T22:57:35.050173+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:37.014197+0000","last_change":"2021-02-06T22:57:37.014197+0000","last_active":"2021-02-06T22:57:37.014197+0000","last_peered":"2021-02-06T22:57:37.014197+0000","last_clean":"2021-02-06T22:57:37.014197+0000","last_became_active":"2021-02-06T22:52:22.218937+0000","last_became_peered":"2021-02-06T22:52:22.218937+0000","last_unstale":"2021-02-06T22:57:37.014197+0000","last_undegraded":"2021-02-06T22:57:37.014197+0000","last_fullsized":"2021-02-06T22:57:37.014197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:37.014084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:37.014084+0000","last_clean_scrub_stamp":"2021-02-06T22:57:37.014084+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:35.709234+0000","last_change":"2021-02-06T22:57:35.709234+0000","last_active":"2021-02-06T22:57:35.709234+0000","last_peered":"2021-02-06T22:57:35.709234+0000","last_clean":"2021-02-06T22:57:35.709234+0000","last_became_active":"2021-02-06T22:52:22.219962+0000","last_became_peered":"2021-02-06T22:52:22.219962+0000","last_unstale":"2021-02-06T22:57:35.709234+0000","last_undegraded":"2021-02-06T22:57:35.709234+0000","last_fullsized":"2021-02-06T22:57:35.709234+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:35.709125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:35.709125+0000","last_clean_scrub_stamp":"2021-02-06T22:57:35.709125+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2021-02-06T22:57:39.605176+0000","last_change":"2021-02-06T22:57:39.605176+0000","last_active":"2021-02-06T22:57:39.605176+0000","last_peered":"2021-02-06T22:57:39.605176+0000","last_clean":"2021-02-06T22:57:39.605176+0000","last_became_active":"2021-02-06T22:52:22.218477+0000","last_became_peered":"2021-02-06T22:52:22.218477+0000","last_unstale":"2021-02-06T22:57:39.605176+0000","last_undegraded":"2021-02-06T22:57:39.605176+0000","last_fullsized":"2021-02-06T22:57:39.605176+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-06T22:57:39.605063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-06T22:57:39.605063+0000","last_clean_scrub_stamp":"2021-02-06T22:57:39.605063+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640325,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86599999999999999,"15min":0.88100000000000001},"min":{"1min":0.63600000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.159,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.875,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.085,"5min":1.292,"15min":1.292},"last":0.86799999999999999}]},{"osd":1,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.95699999999999996,"15min":0.96499999999999997},"min":{"1min":0.78600000000000003,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.2250000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0960000000000001,"15min":1.1080000000000001},"min":{"1min":0.64200000000000002,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.2729999999999999,"5min":1.395,"15min":1.395},"last":0.71099999999999997}]},{"osd":2,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.91900000000000004,"15min":0.89900000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1359999999999999,"5min":1.204,"15min":1.204},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.95299999999999996,"15min":0.91100000000000003},"min":{"1min":0.77500000000000002,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.1859999999999999,"5min":1.508,"15min":1.508},"last":1.024}]},{"osd":3,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77100000000000002,"15min":0.78300000000000003},"min":{"1min":0.58699999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91400000000000003,"5min":1.204,"15min":1.204},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.86099999999999999},"min":{"1min":0.64600000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.081,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.125}]},{"osd":4,"last update":"Sat Feb 6 22:57:27 2021","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.84799999999999998,"15min":0.85099999999999998},"min":{"1min":0.57899999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.91000000000000003,"15min":0.91800000000000004},"min":{"1min":0.66300000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1399999999999999,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":1}]}]},{"osd":4,"up_from":11,"seq":47244640324,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.89700000000000002,"15min":0.91100000000000003},"min":{"1min":0.63300000000000001,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.254,"5min":1.339,"15min":1.339},"last":0.755},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96199999999999997,"15min":0.96999999999999997},"min":{"1min":0.78200000000000003,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.2190000000000001,"5min":1.288,"15min":1.288},"last":0.95899999999999996}]},{"osd":1,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.90400000000000003,"15min":0.93500000000000005},"min":{"1min":0.69499999999999995,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.206,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.92600000000000005,"15min":0.89800000000000002},"min":{"1min":0.84199999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":1.101}]},{"osd":2,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.93899999999999995,"15min":0.94399999999999995},"min":{"1min":0.65900000000000003,"5min":0.625,"15min":0.625},"max":{"1min":1.1679999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.73099999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.75900000000000001,"15min":0.73899999999999999},"min":{"1min":0.54800000000000004,"5min":0.5,"15min":0.5},"max":{"1min":1.0429999999999999,"5min":1.177,"15min":1.177},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93799999999999994,"5min":1.0009999999999999,"15min":0.97499999999999998},"min":{"1min":0.70599999999999996,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.073,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.62}]},{"osd":5,"last update":"Sat Feb 6 22:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1020000000000001,"5min":1.423,"15min":1.423},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.92200000000000004,"15min":0.92100000000000004},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1719999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.67500000000000004}]}]},{"osd":3,"up_from":11,"seq":47244640325,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.94299999999999995,"15min":0.89800000000000002},"min":{"1min":0.53000000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.216},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0580000000000001,"15min":1.0429999999999999},"min":{"1min":0.68899999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.0720000000000001}]},{"osd":1,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0649999999999999,"15min":1.0800000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.96899999999999997,"15min":0.96799999999999997},"min":{"1min":0.59899999999999998,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.1579999999999999}]},{"osd":2,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.879,"15min":0.876},"min":{"1min":0.65300000000000002,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.123,"5min":1.234,"15min":1.234},"last":1.032},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.90500000000000003,"15min":0.91700000000000004},"min":{"1min":0.68899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.208,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.98599999999999999}]},{"osd":4,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.58199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.90600000000000003,"5min":1.081,"15min":1.081},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80300000000000005,"15min":0.84499999999999997},"min":{"1min":0.61699999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.024,"5min":1.119,"15min":1.119},"last":0.749}]},{"osd":5,"last update":"Sat Feb 6 22:57:25 2021","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84899999999999998,"15min":0.874},"min":{"1min":0.67300000000000004,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2929999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.89100000000000001,"15min":0.91800000000000004},"min":{"1min":0.753,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.165,"5min":1.399,"15min":1.399},"last":0.83899999999999997}]}]},{"osd":2,"up_from":11,"seq":47244640327,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.50800000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67000000000000004,"15min":0.66500000000000004},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1879999999999999,"5min":1.266,"15min":1.266},"last":1.008}]},{"osd":1,"last update":"Sat Feb 6 22:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81599999999999995,"15min":0.79500000000000004},"min":{"1min":0.54300000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.111,"5min":1.407,"15min":1.407},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84099999999999997,"15min":0.84299999999999997},"min":{"1min":0.65900000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1799999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.77500000000000002}]},{"osd":3,"last update":"Sat Feb 6 22:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.92500000000000004,"15min":0.93700000000000006},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2509999999999999,"5min":1.371,"15min":1.371},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.016,"15min":1.004},"min":{"1min":0.73999999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.478,"5min":1.649,"15min":1.649},"last":0.92200000000000004}]},{"osd":4,"last update":"Sat Feb 6 22:57:37 2021","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":1.026,"15min":1.038},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1819999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.1060000000000001,"15min":1.038},"min":{"1min":0.84499999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.575,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":1.1379999999999999}]},{"osd":5,"last update":"Sat Feb 6 22:57:37 2021","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.115,"15min":1.131},"min":{"1min":0.88400000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.508,"5min":1.756,"15min":1.756},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.139,"15min":1.117},"min":{"1min":0.82799999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6719999999999999,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2450000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640325,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4872,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366968,"statfs":{"total":96636764160,"available":96631775232,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.64500000000000002,"15min":0.64600000000000002},"min":{"1min":0.51400000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.83799999999999997},"min":{"1min":0.70399999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.1739999999999999,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.88700000000000001}]},{"osd":2,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.73899999999999999,"15min":0.755},"min":{"1min":0.49299999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.88500000000000001,"15min":0.90600000000000003},"min":{"1min":0.58999999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1060000000000001,"5min":1.325,"15min":1.325},"last":0.73999999999999999}]},{"osd":3,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":1.095},"min":{"1min":0.73499999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1890000000000001,"5min":2.9910000000000001,"15min":2.9910000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.0449999999999999,"5min":1.0189999999999999,"15min":1.0429999999999999},"min":{"1min":0.83299999999999996,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3460000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.81499999999999995}]},{"osd":4,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.012,"15min":1.1000000000000001},"min":{"1min":0.73699999999999999,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.319,"5min":3.073,"15min":3.073},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.052,"15min":1.0960000000000001},"min":{"1min":0.875,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.26,"5min":1.401,"15min":1.401},"last":1.0049999999999999}]},{"osd":5,"last update":"Sat Feb 6 22:57:24 2021","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0309999999999999,"15min":1.0529999999999999},"min":{"1min":0.80300000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.276,"5min":1.419,"15min":1.419},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1240000000000001,"15min":1.222},"min":{"1min":0.81499999999999995,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4610000000000001,"5min":3.149,"15min":3.149},"last":1.075}]}]},{"osd":1,"up_from":11,"seq":47244640325,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4936,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366904,"statfs":{"total":96636764160,"available":96631709696,"internally_reserved":0,"allocated":131072,"data_stored":35983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 6 22:57:34 2021","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.66100000000000003},"min":{"1min":0.48399999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0209999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.62},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82199999999999995,"15min":0.81799999999999995},"min":{"1min":0.64200000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.82099999999999995}]},{"osd":2,"last update":"Sat Feb 6 22:57:34 2021","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68000000000000005,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.999,"5min":1.157,"15min":1.157},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.85599999999999998,"15min":0.83599999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Sat Feb 6 22:57:34 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.98499999999999999,"15min":0.97899999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2470000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":1.024},{"interface":"front","average":{"1min":0.998,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.2929999999999999,"5min":1.488,"15min":1.488},"last":1.169}]},{"osd":4,"last update":"Sat Feb 6 22:57:34 2021","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.96999999999999997,"15min":0.99199999999999999},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.1060000000000001,"5min":1.387,"15min":1.387},"last":1.079},{"interface":"front","average":{"1min":1.0469999999999999,"5min":0.999,"15min":0.95999999999999996},"min":{"1min":0.80100000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":1.0589999999999999}]},{"osd":5,"last update":"Sat Feb 6 22:57:34 2021","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":1.036,"15min":1.02},"min":{"1min":0.78500000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1559999999999999,"15min":1.1479999999999999},"min":{"1min":0.879,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.431,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.2729999999999999}]}]}]}} 2021-02-06T22:57:56.456 DEBUG:teuthology.orchestra.run.smithi051:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2021-02-06T22:57:56.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.579+0000 7f1706cf9700 1 Processor -- start 2021-02-06T22:57:56.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.579+0000 7f1706cf9700 1 -- start start 2021-02-06T22:57:56.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.579+0000 7f1706cf9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17000944b0 con 0x7f170008f600 2021-02-06T22:57:56.579 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.580+0000 7f1706cf9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700090fc0 con 0x7f1700092c50 2021-02-06T22:57:56.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.580+0000 7f1706cf9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700091260 con 0x7f170012cef0 2021-02-06T22:57:56.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.580+0000 7f1705296700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f170012cef0 0x7f170012f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33336/0 (socket says 172.21.15.51:33336) 2021-02-06T22:57:56.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.580+0000 7f1704a95700 1 --1- >> v1:172.21.15.51:6789/0 conn(0x7f170008f600 0x7f1700093da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.51:6789/0 says I am v1:172.21.15.51:32990/0 (socket says 172.21.15.51:32990) 2021-02-06T22:57:56.580 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.580+0000 7f1705296700 1 -- 172.21.15.51:0/4068818007 learned_addr learned my addr 172.21.15.51:0/4068818007 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:56.584 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f1705296700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.51:6790/0 conn(0x7f170012cef0 legacy=0x7f170012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.585 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f1704a95700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.51:6789/0 conn(0x7f170008f600 legacy=0x7f1700093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16fffff700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.106:6789/0 conn(0x7f1700092c50 legacy=0x7f17000930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742510044 0 0) 0x7f1700091260 con 0x7f170012cef0 2021-02-06T22:57:56.586 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e4003230 con 0x7f170012cef0 2021-02-06T22:57:56.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425403469 0 0) 0x7f1700090fc0 con 0x7f1700092c50 2021-02-06T22:57:56.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1700091260 con 0x7f1700092c50 2021-02-06T22:57:56.587 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819658661 0 0) 0x7f17000944b0 con 0x7f170008f600 2021-02-06T22:57:56.588 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.582+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1700090fc0 con 0x7f170008f600 2021-02-06T22:57:56.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2646318106 0 0) 0x7f16e4003230 con 0x7f170012cef0 2021-02-06T22:57:56.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.106:6789/0 conn(0x7f1700092c50 legacy=0x7f17000930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.51:6789/0 conn(0x7f170008f600 legacy=0x7f1700093da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.589 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 --> v1:172.21.15.51:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700091500 con 0x7f170012cef0 2021-02-06T22:57:56.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16f8001cb0 con 0x7f170012cef0 2021-02-06T22:57:56.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.2 v1:172.21.15.51:6790/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f16f8001fc0 con 0x7f170012cef0 2021-02-06T22:57:56.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f16ff7fe700 1 -- 172.21.15.51:0/4068818007 <== mon.2 v1:172.21.15.51:6790/0 5 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16f8004ad0 con 0x7f170012cef0 2021-02-06T22:57:56.590 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f1706cf9700 1 -- 172.21.15.51:0/4068818007 >> v1:172.21.15.51:6790/0 conn(0x7f170012cef0 legacy=0x7f170012f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f1706cf9700 1 -- 172.21.15.51:0/4068818007 shutdown_connections 2021-02-06T22:57:56.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f1706cf9700 1 -- 172.21.15.51:0/4068818007 >> 172.21.15.51:0/4068818007 conn(0x7f1700099460 msgr2=0x7f1700099870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:56.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f1706cf9700 1 -- 172.21.15.51:0/4068818007 shutdown_connections 2021-02-06T22:57:56.591 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.583+0000 7f1706cf9700 1 -- 172.21.15.51:0/4068818007 wait complete. 2021-02-06T22:57:56.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 librados: starting msgr at 2021-02-06T22:57:56.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 librados: starting objecter 2021-02-06T22:57:56.592 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 Processor -- start 2021-02-06T22:57:56.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 -- start start 2021-02-06T22:57:56.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 librados: setting wanted keys 2021-02-06T22:57:56.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.584+0000 7f1706cf9700 1 librados: calling monclient init 2021-02-06T22:57:56.593 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.585+0000 7f1706cf9700 1 -- --> v1:172.21.15.51:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700130f10 con 0x7f170012cef0 2021-02-06T22:57:56.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.585+0000 7f1706cf9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1700117240 con 0x7f1700092c50 2021-02-06T22:57:56.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.585+0000 7f1706cf9700 1 -- --> v1:172.21.15.51:6790/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17001174e0 con 0x7f170008f600 2021-02-06T22:57:56.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.585+0000 7f1704a95700 1 --1- >> v1:172.21.15.51:6790/0 conn(0x7f170008f600 0x7f170013a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.51:6790/0 says I am v1:172.21.15.51:33338/0 (socket says 172.21.15.51:33338) 2021-02-06T22:57:56.594 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.585+0000 7f1704a95700 1 -- 172.21.15.51:0/1762073517 learned_addr learned my addr 172.21.15.51:0/1762073517 (peer_addr_for_me v1:172.21.15.51:0/0) 2021-02-06T22:57:56.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f1704a95700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.51:6790/0 conn(0x7f170008f600 legacy=0x7f170013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter ms_handle_connect 0x7f170008f600 2021-02-06T22:57:56.598 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f1705296700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.51:6789/0 conn(0x7f170012cef0 legacy=0x7f1700142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter ms_handle_connect 0x7f170012cef0 2021-02-06T22:57:56.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.599 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.2 v1:172.21.15.51:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923998870 0 0) 0x7f17001174e0 con 0x7f170008f600 2021-02-06T22:57:56.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e0004bd0 con 0x7f170008f600 2021-02-06T22:57:56.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fffff700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.106:6789/0 conn(0x7f1700092c50 legacy=0x7f170013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2021-02-06T22:57:56.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter ms_handle_connect 0x7f1700092c50 2021-02-06T22:57:56.600 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 10 client.?.objecter resend_mon_ops 2021-02-06T22:57:56.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973836759 0 0) 0x7f1700130f10 con 0x7f170012cef0 2021-02-06T22:57:56.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17001174e0 con 0x7f170012cef0 2021-02-06T22:57:56.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3606474175 0 0) 0x7f17001174e0 con 0x7f170012cef0 2021-02-06T22:57:56.601 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1700130f10 con 0x7f170012cef0 2021-02-06T22:57:56.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16f8001c70 con 0x7f170012cef0 2021-02-06T22:57:56.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.2 v1:172.21.15.51:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3611056257 0 0) 0x7f16e0004bd0 con 0x7f170008f600 2021-02-06T22:57:56.602 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17001174e0 con 0x7f170008f600 2021-02-06T22:57:56.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.2 v1:172.21.15.51:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16f40018d0 con 0x7f170008f600 2021-02-06T22:57:56.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453946276 0 0) 0x7f1700117240 con 0x7f1700092c50 2021-02-06T22:57:56.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.587+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16e0004bd0 con 0x7f1700092c50 2021-02-06T22:57:56.603 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1788830440 0 0) 0x7f1700130f10 con 0x7f170012cef0 2021-02-06T22:57:56.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.51:6790/0 conn(0x7f170008f600 legacy=0x7f170013a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.106:6789/0 conn(0x7f1700092c50 legacy=0x7f170013ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:56.604 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700117780 con 0x7f170012cef0 2021-02-06T22:57:56.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17001111d0 con 0x7f170012cef0 2021-02-06T22:57:56.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f1706cf9700 10 client.4947.objecter _maybe_request_map subscribing (onetime) to next osd map 2021-02-06T22:57:56.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f17001164d0 con 0x7f170012cef0 2021-02-06T22:57:56.605 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f1706cf9700 1 librados: init done 2021-02-06T22:57:56.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f16f8005080 con 0x7f170012cef0 2021-02-06T22:57:56.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 74850221 0 0) 0x7f16f80051f0 con 0x7f170012cef0 2021-02-06T22:57:56.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.588+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 7 ==== mgrmap(e 4) v1 ==== 34392+0+0 (unknown 1910601749 0 0) 0x7f16f800d9b0 con 0x7f170012cef0 2021-02-06T22:57:56.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 8 ==== osd_map(15..15 src has 1..15) v4 ==== 3149+0+0 (unknown 403934842 0 0) 0x7f16f8039900 con 0x7f170012cef0 2021-02-06T22:57:56.606 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f16fcff9700 10 client.4947.objecter ms_dispatch 0x7f1700001510 osd_map(15..15 src has 1..15) v4 2021-02-06T22:57:56.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f16fcff9700 3 client.4947.objecter handle_osd_map got epochs [15,15] > 0 2021-02-06T22:57:56.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f16fcff9700 3 client.4947.objecter handle_osd_map decoding full epoch 15 2021-02-06T22:57:56.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f16fcff9700 20 client.4947.objecter dump_active .. 0 homeless 2021-02-06T22:57:56.607 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.589+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d8004d60 con 0x7f170012cef0 2021-02-06T22:57:56.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.591+0000 7f16fcff9700 10 client.4947.objecter ms_handle_connect 0x7f16e00306d0 2021-02-06T22:57:56.608 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.593+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+146103 (unknown 1092875540 0 3844415193) 0x7f16f8012800 con 0x7f170012cef0 2021-02-06T22:57:56.766 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:56.767+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 --> v1:172.21.15.51:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f16d80059b0 con 0x7f170012cef0 2021-02-06T22:57:57.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.016+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 10 ==== config(1 keys) v1 ==== 35+0+0 (unknown 2555425225 0 0) 0x7f16f8012800 con 0x7f170012cef0 2021-02-06T22:57:57.015 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.016+0000 7f16fcff9700 1 -- 172.21.15.51:0/1762073517 <== mon.0 v1:172.21.15.51:6789/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (unknown 691139944 0 0) 0x7f16f80123f0 con 0x7f170012cef0 2021-02-06T22:57:57.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 10 librados: watch_flush enter 2021-02-06T22:57:57.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 10 librados: watch_flush exit 2021-02-06T22:57:57.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 20 client.4947.objecter shutdown clearing up homeless session... 2021-02-06T22:57:57.018 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 10 client.4947.objecter successfully canceled tick 2021-02-06T22:57:57.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.106:6812/33219 conn(0x7f16e00306d0 legacy=0x7f16e0032b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:57.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 >> v1:172.21.15.51:6789/0 conn(0x7f170012cef0 legacy=0x7f1700142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-02-06T22:57:57.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 shutdown_connections 2021-02-06T22:57:57.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 >> 172.21.15.51:0/1762073517 conn(0x7f1700099460 msgr2=0x7f170012f430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-02-06T22:57:57.019 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 shutdown_connections 2021-02-06T22:57:57.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 -- 172.21.15.51:0/1762073517 wait complete. 2021-02-06T22:57:57.020 INFO:teuthology.orchestra.run.smithi051.stderr:2021-02-06T22:57:57.018+0000 7f1706cf9700 1 librados: shutdown 2021-02-06T22:57:57.029 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1883, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1449, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph_manager.py", line 2900, in wait_until_healthy 'timeout expired in wait_until_healthy' AssertionError: timeout expired in wait_until_healthy 2021-02-06T22:57:57.030 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-06T22:57:57.030 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-06T22:57:57.031 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2021-02-06T22:57:57.031 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.057 INFO:tasks.ceph.osd.0:Stopped 2021-02-06T22:57:57.058 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2021-02-06T22:57:57.059 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.121 INFO:tasks.ceph.osd.1:Stopped 2021-02-06T22:57:57.122 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2021-02-06T22:57:57.122 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.191 INFO:tasks.ceph.osd.2:Stopped 2021-02-06T22:57:57.192 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2021-02-06T22:57:57.192 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.221 INFO:tasks.ceph.osd.3:Stopped 2021-02-06T22:57:57.222 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2021-02-06T22:57:57.222 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.292 INFO:tasks.ceph.osd.4:Stopped 2021-02-06T22:57:57.292 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2021-02-06T22:57:57.293 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.371 INFO:tasks.ceph.osd.5:Stopped 2021-02-06T22:57:57.372 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-06T22:57:57.373 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2021-02-06T22:57:57.374 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.432 INFO:tasks.ceph.mgr.x:Stopped 2021-02-06T22:57:57.433 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-06T22:57:57.434 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2021-02-06T22:57:57.434 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.445 INFO:tasks.ceph.mon.a:Stopped 2021-02-06T22:57:57.446 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2021-02-06T22:57:57.446 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.496 INFO:tasks.ceph.mon.c:Stopped 2021-02-06T22:57:57.497 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2021-02-06T22:57:57.497 INFO:teuthology.orchestra.run:waiting for 300 2021-02-06T22:57:57.508 INFO:tasks.ceph.mon.b:Stopped 2021-02-06T22:57:57.508 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-06T22:57:57.509 DEBUG:teuthology.orchestra.run.smithi051:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2021-02-06T22:57:57.572 INFO:teuthology.orchestra.run.smithi051.stdout:2021-02-06T22:52:14.645162+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Unhandled exception from module 'devicehealth' while running on mgr.x: name 'cast' is not defined 2021-02-06T22:57:57.572 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2021-02-06T22:57:57.573 DEBUG:teuthology.orchestra.run.smithi051:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2021-02-06T22:57:57.645 DEBUG:teuthology.orchestra.run.smithi051:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2021-02-06T22:57:57.718 INFO:teuthology.orchestra.run.smithi051.stdout:2021-02-06T22:52:14.645162+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Unhandled exception from module 'devicehealth' while running on mgr.x: name 'cast' is not defined 2021-02-06T22:57:57.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:57:57.741 DEBUG:teuthology.orchestra.run.smithi051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2021-02-06T22:57:57.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:57:57.981 DEBUG:teuthology.orchestra.run.smithi051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2021-02-06T22:57:58.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:57:58.089 DEBUG:teuthology.orchestra.run.smithi051:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2021-02-06T22:57:58.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:57:58.165 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2021-02-06T22:57:58.330 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:57:58.330 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2021-02-06T22:57:58.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:57:58.433 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2021-02-06T22:57:58.497 INFO:tasks.ceph:Archiving mon data... 2021-02-06T22:57:58.499 DEBUG:teuthology.misc:Transferring archived files from smithi051:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/data/mon.a.tgz 2021-02-06T22:57:58.499 DEBUG:teuthology.orchestra.run.smithi051:> mktemp 2021-02-06T22:57:58.517 INFO:teuthology.orchestra.run.smithi051.stdout:/tmp/tmp.4i7QXvKThf 2021-02-06T22:57:58.518 DEBUG:teuthology.orchestra.run.smithi051:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4i7QXvKThf 2021-02-06T22:57:58.726 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 0666 /tmp/tmp.4i7QXvKThf 2021-02-06T22:57:58.811 DEBUG:teuthology.orchestra.remote:smithi051:/tmp/tmp.4i7QXvKThf is 468KB 2021-02-06T22:57:58.908 DEBUG:teuthology.orchestra.run.smithi051:> rm -fr /tmp/tmp.4i7QXvKThf 2021-02-06T22:57:58.922 DEBUG:teuthology.misc:Transferring archived files from smithi051:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/data/mon.c.tgz 2021-02-06T22:57:58.923 DEBUG:teuthology.orchestra.run.smithi051:> mktemp 2021-02-06T22:57:58.976 INFO:teuthology.orchestra.run.smithi051.stdout:/tmp/tmp.sQbvltryAY 2021-02-06T22:57:58.977 DEBUG:teuthology.orchestra.run.smithi051:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.sQbvltryAY 2021-02-06T22:57:59.152 DEBUG:teuthology.orchestra.run.smithi051:> sudo chmod 0666 /tmp/tmp.sQbvltryAY 2021-02-06T22:57:59.234 DEBUG:teuthology.orchestra.remote:smithi051:/tmp/tmp.sQbvltryAY is 468KB 2021-02-06T22:57:59.332 DEBUG:teuthology.orchestra.run.smithi051:> rm -fr /tmp/tmp.sQbvltryAY 2021-02-06T22:57:59.347 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/data/mon.b.tgz 2021-02-06T22:57:59.347 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2021-02-06T22:57:59.364 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.M9nGY3gPRH 2021-02-06T22:57:59.365 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.M9nGY3gPRH 2021-02-06T22:57:59.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.M9nGY3gPRH 2021-02-06T22:57:59.643 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.M9nGY3gPRH is 468KB 2021-02-06T22:57:59.741 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.M9nGY3gPRH 2021-02-06T22:57:59.755 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-06T22:57:59.755 DEBUG:teuthology.orchestra.run.smithi051:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-06T22:57:59.758 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2021-02-06T22:57:59.819 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-02-06T22:57:59.821 DEBUG:teuthology.orchestra.run.smithi051:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-06T22:57:59.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-06T22:57:59.851 INFO:teuthology.orchestra.run.smithi051.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-06T22:57:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-06T22:57:59.889 INFO:tasks.ceph:Archiving crash dumps... 2021-02-06T22:57:59.891 DEBUG:teuthology.misc:Transferring archived files from smithi051:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi051/crash 2021-02-06T22:57:59.892 DEBUG:teuthology.orchestra.run.smithi051:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-06T22:57:59.925 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi106/crash 2021-02-06T22:57:59.926 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-06T22:57:59.955 INFO:tasks.ceph:Compressing logs... 2021-02-06T22:57:59.956 DEBUG:teuthology.orchestra.run.smithi051:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-06T22:57:59.966 DEBUG:teuthology.orchestra.run.smithi106:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-06T22:58:01.339 INFO:tasks.ceph:Archiving logs... 2021-02-06T22:58:01.339 DEBUG:teuthology.misc:Transferring archived files from smithi051:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi051/log 2021-02-06T22:58:01.341 DEBUG:teuthology.orchestra.run.smithi051:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-06T22:58:01.662 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi106/log 2021-02-06T22:58:01.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-06T22:58:01.902 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1883, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1449, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph_manager.py", line 2900, in wait_until_healthy 'timeout expired in wait_until_healthy' AssertionError: timeout expired in wait_until_healthy 2021-02-06T22:58:02.039 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d9446c4b61c14efdaf7d6bb240641337 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_17c099650191e7aa47a7d9f502facca74f9b4d44/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1883, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph.py", line 1449, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_39ebd5ec4ebd7319faeb68d09b00b18fb45299cc/qa/tasks/ceph_manager.py", line 2900, in wait_until_healthy 'timeout expired in wait_until_healthy' AssertionError: timeout expired in wait_until_healthy 2021-02-06T22:58:02.042 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-06T22:58:02.068 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-02-06T22:58:02.122 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-02-06T22:58:02.122 DEBUG:teuthology.orchestra.run.smithi051:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-06T22:58:02.134 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-06T22:58:02.193 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-02-06T22:58:02.206 INFO:teuthology.task.clock:Checking final clock skew... 2021-02-06T22:58:02.207 DEBUG:teuthology.orchestra.run.smithi051:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-06T22:58:02.222 INFO:teuthology.orchestra.run.smithi051.stderr:bash: ntpq: command not found 2021-02-06T22:58:02.226 INFO:teuthology.orchestra.run.smithi051.stdout:210 Number of sources = 4 2021-02-06T22:58:02.227 INFO:teuthology.orchestra.run.smithi051.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-06T22:58:02.227 INFO:teuthology.orchestra.run.smithi051.stdout:=============================================================================== 2021-02-06T22:58:02.227 INFO:teuthology.orchestra.run.smithi051.stdout:^- hv01.front.sepia.ceph.com 3 6 377 62 +2954us[+2954us] +/- 145ms 2021-02-06T22:58:02.228 INFO:teuthology.orchestra.run.smithi051.stdout:^* hv02.front.sepia.ceph.com 2 6 377 64 +419us[ +420us] +/- 37ms 2021-02-06T22:58:02.228 INFO:teuthology.orchestra.run.smithi051.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 64 +436us[ +437us] +/- 63ms 2021-02-06T22:58:02.229 INFO:teuthology.orchestra.run.smithi051.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 62 -812us[ -812us] +/- 46ms 2021-02-06T22:58:02.229 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-06T22:58:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2021-02-06T22:58:02.247 INFO:teuthology.orchestra.run.smithi106.stdout:210 Number of sources = 4 2021-02-06T22:58:02.247 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-06T22:58:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2021-02-06T22:58:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:^- hv01.front.sepia.ceph.com 3 6 377 62 +2925us[+2940us] +/- 145ms 2021-02-06T22:58:02.249 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv02.front.sepia.ceph.com 2 6 377 62 +402us[ +417us] +/- 37ms 2021-02-06T22:58:02.249 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +414us[ +429us] +/- 63ms 2021-02-06T22:58:02.249 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 63 -830us[ -815us] +/- 46ms 2021-02-06T22:58:02.250 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-02-06T22:58:02.262 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-02-06T22:58:02.262 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-02-06T22:58:02.295 DEBUG:teuthology.orchestra.run.smithi051:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2021-02-06T22:58:02.359 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2021-02-06T22:58:02.416 DEBUG:teuthology.orchestra.run.smithi051:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-06T22:58:02.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:58:02.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-06T22:58:02.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:58:02.475 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-02-06T22:58:02.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-02-06T22:58:02.502 INFO:teuthology.task.internal:Duration was 833.005154 seconds 2021-02-06T22:58:02.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-02-06T22:58:02.560 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-02-06T22:58:02.561 DEBUG:teuthology.orchestra.run.smithi051:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-06T22:58:02.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-06T22:58:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-06T22:58:02.612 INFO:teuthology.orchestra.run.smithi051.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-06T22:58:02.839 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-02-06T22:58:02.840 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi051.front.sepia.ceph.com 2021-02-06T22:58:02.840 DEBUG:teuthology.orchestra.run.smithi051:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-06T22:58:02.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2021-02-06T22:58:02.863 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-06T22:58:02.898 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-02-06T22:58:02.899 DEBUG:teuthology.orchestra.run.smithi051:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-06T22:58:02.918 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-06T22:58:02.974 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-02-06T22:58:03.004 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-02-06T22:58:03.005 DEBUG:teuthology.orchestra.run.smithi051:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-06T22:58:03.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-06T22:58:03.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-02-06T22:58:03.074 DEBUG:teuthology.orchestra.run.smithi051:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-06T22:58:03.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-06T22:58:03.101 INFO:teuthology.orchestra.run.smithi051.stdout:kernel.core_pattern = core 2021-02-06T22:58:03.123 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2021-02-06T22:58:03.125 DEBUG:teuthology.orchestra.run.smithi051:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-06T22:58:03.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:58:03.159 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-06T22:58:03.179 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-06T22:58:03.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-02-06T22:58:03.190 INFO:teuthology.task.internal:Transferring archived files... 2021-02-06T22:58:03.191 DEBUG:teuthology.misc:Transferring archived files from smithi051:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi051 2021-02-06T22:58:03.191 DEBUG:teuthology.orchestra.run.smithi051:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-06T22:58:03.240 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482/remote/smithi106 2021-02-06T22:58:03.240 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-06T22:58:03.278 INFO:teuthology.task.internal:Removing archive directory... 2021-02-06T22:58:03.278 DEBUG:teuthology.orchestra.run.smithi051:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-06T22:58:03.281 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-06T22:58:03.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-02-06T22:58:03.337 INFO:teuthology.task.internal:Not uploading archives. 2021-02-06T22:58:03.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-02-06T22:58:03.398 INFO:teuthology.task.internal:Tidying up after the test... 2021-02-06T22:58:03.399 DEBUG:teuthology.orchestra.run.smithi051:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-06T22:58:03.402 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-06T22:58:03.414 INFO:teuthology.orchestra.run.smithi051.stdout: 394943 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 6 22:58 /home/ubuntu/cephtest 2021-02-06T22:58:03.416 INFO:teuthology.orchestra.run.smithi106.stdout: 394299 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 6 22:58 /home/ubuntu/cephtest 2021-02-06T22:58:03.417 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-02-06T22:58:03.502 INFO:teuthology.nuke:Checking targets against current locks 2021-02-06T22:58:03.589 DEBUG:teuthology.nuke:shortname: smithi051 2021-02-06T22:58:03.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-06T22:58:03.593 DEBUG:teuthology.nuke:shortname: smithi106 2021-02-06T22:58:03.594 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-06T22:58:03.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-06 22:35:52.141860', 'description': '/home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDjrPeE+qpRsebVTSNeTgeYTJxASEQ3UAZtzufwYKkhrqnSEQmbL4oUieaEIsqou3HWw0bIK0FszBAJsIGcfRhT8i8PKBCzH73E77F+9coJX/kjuuqmh7wYDMhGI3v3gl0kL/8zwr5Z9Q6JiBdHgHdPFmmcKUQZCt1xF0ssYMCNp12VDioB5x4FpVCcfHL61SxuHnLffxH3MywAcWAXCMxWH+PdiH5HPHwCXUxC5JkoTLdq1zyXvEq+K/KnOkpAH2k3h7GDwUfSjifRZ7ZjBJGUON693loYPBsl6rhUF9XSF8CI6bl2oQ963Z1jfGvg+wtNFtTMLNjE+Pl4/26ZpXFPZ4S1qipDe7E1oAIokmBzbSEVFuZBVmBIdf0XX6NqnW9Ms1BTwn9rdSEWa0jjYKNUmDoPhtiftfGCb7xQEMd/lozHi2oWIDSlPhDb9NMNdekV8qFy+hWDKHCSTHQwhO+E5LFoWgtCir1Uw/I4xmNAjiLF0T5TQcsqTw1V6bCdFJ0=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi051.front.sepia.ceph.com'} 2021-02-06T22:58:03.617 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-06 22:35:52.141880', 'description': '/home/teuthworker/archive/yuriw-2021-02-06_18:09:20-rados-wip-yuri7-testing-2021-02-02-0942-pacific-distro-basic-smithi/5862482', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDHnQTjyZoqdhr0NhIt5gsZMttHBL2P8pNn2mwcUMnfGUna9bxNk0lrsNj4rSxN/DrNngVeIlF4LwBPGnxxxiRD4rue6QN45eiq5SYnD5NuF6zY0DkkNbW2n67ukIy+u7IrpOqx+WQB4jy9GdyrebU31z8GvN6TESNuuu4MAkRMe0EjPg8rYwFEVGiZbo2U7tAgrf5oxls3LOnBJVXIPL/xUp6bpXTWXS6NYj2E2qJhLSo8Bt6G3W4qR490SPSb2LJFQ6jLC0TpgqPRWSoRDHQ5xKSoiqrff4t9a6Bv3H5GAkZCiiyD2tz9Yup/DWJz3KYUL1eW4PuMvkhLgotvOczBZitjTdNJHShtejXbdaDw+YhmWOkS0XwsISZC7tigKR1o8ZPgGi5sOWDYZN8rveWKhi0/nnFmMeK7WVbGefaIV4XdDsj80XtkF30RatbiVMszHJLqnXAhge59fCzuKFKbWO8rtg3ZrblZAPVbqwGrI5CAE9MwYnrU8jrtF/V1M5s=', 'os_version': '8', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'centos', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi106.front.sepia.ceph.com'} 2021-02-06T22:58:03.661 INFO:teuthology.orchestra.console:Power off smithi106 2021-02-06T22:58:03.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-02-06T22:58:03.679 INFO:teuthology.orchestra.console:Power off smithi051 2021-02-06T22:58:03.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-02-06T22:58:03.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:03.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:07.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:07.729 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:11.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:11.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:15.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:15.957 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi051.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-02-06T22:58:16.160 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2021-02-06T22:58:16.167 INFO:teuthology.orchestra.console:Power off for smithi051 completed 2021-02-06T22:58:16.273 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} duration: 833.0051543712616 failure_reason: '"2021-02-06T22:52:14.645162+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Unhandled exception from module ''devicehealth'' while running on mgr.x: name ''cast'' is not defined" in cluster log' flavor: basic owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d9446c4b61c14efdaf7d6bb240641337 status: fail success: false 2021-02-06T22:58:16.273 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-06T22:58:16.324 INFO:teuthology.run:FAIL